Sep 23 00:05:14 devstack cinder-volume[75464]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 23 00:05:14 devstack cinder-volume[75464]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:05:14 devstack cinder-volume[75464]: we strongly recommend against using it for new projects.
Sep 23 00:05:14 devstack cinder-volume[75464]: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:05:14 devstack cinder-volume[75464]: framework.  For more detail see
Sep 23 00:05:14 devstack cinder-volume[75464]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:05:14 devstack cinder-volume[75464]:   import eventlet  # noqa
Sep 23 00:05:17 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:05:17 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:05:17 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:05:18 devstack cinder-volume[75464]: INFO dbcounter [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Registered counter for database cinder
Sep 23 00:05:18 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:05:19 devstack cinder-volume[75464]: DEBUG dbcounter [-] [75464] Writer thread running {{(pid=75464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:05:19 devstack cinder-volume[75464]: INFO cinder.rpc [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 00:05:19 devstack cinder-volume[75464]: INFO cinder.rpc [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 00:05:19 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:05:19 devstack cinder-volume[75464]: INFO cinder.volume.manager [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Determined volume DB was empty at startup.
Sep 23 00:05:19 devstack cinder-volume[75464]: DEBUG cinder.volume.manager [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75464) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 23 00:05:19 devstack cinder-volume[75464]: INFO cinder.volume.manager [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 23 00:05:19 devstack cinder-volume[75464]: WARNING stevedore.named [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:05:19 devstack cinder-volume[75464]: WARNING castellan.key_manager [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:05:19 devstack cinder-volume[75464]: WARNING cinder.keymgr.conf_key_mgr [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:05:19 devstack cinder-volume[75464]: DEBUG cinder.volume.drivers.lvm [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75464) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 23 00:05:19 devstack cinder-volume[75464]: DEBUG oslo_concurrency.processutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:19 devstack cinder-volume[75464]: DEBUG oslo_concurrency.processutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] CMD "cinder-rtstool verify" returned: 0 in 0.459s {{(pid=75464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:05:20 devstack cinder-volume[75464]: INFO cinder.rpc [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 23 00:05:20 devstack cinder-volume[75464]: INFO cinder.rpc [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 23 00:05:20 devstack cinder-volume[75464]: WARNING stevedore.named [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:05:20 devstack cinder-volume[75464]: WARNING castellan.key_manager [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:05:20 devstack cinder-volume[75464]: INFO cinder.volume.manager [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:05:20 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Starting 1 workers
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Started child 75634 {{(pid=75464) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Full set of CONF: {{(pid=75464) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] ******************************************************************************** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Configuration options gathered from: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] ================================================================================ {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] allow_availability_zone_fallback = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] allow_compression_on_image_upload = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75634]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] allowed_direct_url_schemes     = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] api_rate_limit                 = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] auth_strategy                  = keystone {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] az_cache_duration              = 3600 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_availability_zone      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_host                   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_name                   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_stats_polling_interval = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backup_api_class               = cinder.backup.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backup_name_template           = backup-%s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backup_use_same_host           = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backup_use_temp_snapshot       = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] chap_password                  = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] chap_username                  =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_internal_tenant_project_id = b60553a8bbe246b0808f26924eac5f2d {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_internal_tenant_user_id = 00ac3d052e3e497da4aa09c28fb876e6 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cloned_volume_same_az          = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cluster                        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] compression_format             = gzip {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] compute_api_class              = cinder.compute.nova.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] config_dir                     = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] config_source                  = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] control_exchange               = openstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] debug                          = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] default_availability_zone      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] default_group_type             = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] default_volume_type            = lvmdriver-1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] deployment_max_gigabytes       = -1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] disk_geometry                  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] driver_client_cert             = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] driver_client_cert_key         = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] driver_data_namespace          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] driver_ssl_cert_path           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] driver_ssl_cert_verify         = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] driver_use_ssl                 = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] enable_force_upload            = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] enable_new_services            = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] enable_unsupported_driver      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] enforce_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] filter_function                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_api_insecure            = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_api_ssl_compression     = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_ca_certificates_file    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_catalog_info            = image:glance:publicURL {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_certfile                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_keyfile                 = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_num_retries             = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance_request_timeout         = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] goodness_function              = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] graceful_shutdown_timeout      = 5 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] group_api_class                = cinder.group.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] host                           = devstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_compress_on_upload       = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_conversion_address_space_limit = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_conversion_cpu_limit     = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_conversion_disable       = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_introspection_address_space_limit = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_introspection_cpu_limit  = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_upload_use_cinder_backend = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_upload_use_internal_tenant = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_volume_cache_enabled     = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_volume_cache_max_count   = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] image_volume_cache_max_size_gb = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] init_host_max_objects_retrieval = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] instance_format                = [instance: %(uuid)s]  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75634]: INFO cinder.volume.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] iscsi_target_flags             =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] iscsi_write_cache              = on {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] iser_helper                    = tgtadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] iser_ip_address                = 192.168.122.53 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] iser_port                      = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_color                      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_config_append              = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_dir                        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_file                       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_options                    = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_rotate_interval            = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_rotate_interval_type       = days {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] log_rotation_type              = none {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] max_age                        = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] max_logfile_count              = 30 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] max_logfile_size_mb            = 200 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] max_over_subscription_ratio    = 20.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] message_reap_interval          = 86400 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] message_ttl                    = 2592000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] migration_create_volume_timeout_secs = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] monkey_patch                   = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] monkey_patch_modules           = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] my_ip                          = 192.168.122.53 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] no_snapshot_gb_quota           = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] num_iser_scan_tries            = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] num_shell_tries                = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] num_volume_device_scan_tries   = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] nvmeof_conn_info_version       = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] nvmet_ns_id                    = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] nvmet_port_id                  = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_max_limit                = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_volume_ext_list          = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_volume_listen_port       = 8776 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_volume_use_ssl           = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] osapi_volume_workers           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] per_volume_size_limit          = -1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] periodic_fuzzy_delay           = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] periodic_interval              = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] public_endpoint                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] publish_errors                 = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_backup_gigabytes         = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_backups                  = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_gigabytes                = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_groups                   = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_snapshots                = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] quota_volumes                  = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] rate_limit_burst               = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] rate_limit_except_level        = CRITICAL {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] rate_limit_interval            = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] reinit_driver_count            = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] replication_device             = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] report_discard_supported       = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] report_interval                = 120 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] reservation_clean_interval     = 86400 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] reservation_expire             = 86400 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] reserved_image_namespaces      = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] reserved_percentage            = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] rpc_response_timeout           = 120 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] run_external_periodic_tasks    = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] scst_target_driver             = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] scst_target_iqn_name           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_down_time              = 720 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] shell_completion               = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] snapshot_name_template         = snapshot-%s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] snapshot_same_host             = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] split_loggers                  = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] state_path                     = /opt/stack/data/cinder {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] storage_availability_zone      = nova {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] storage_protocol               = iSCSI {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] syslog_log_facility            = LOG_USER {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] target_helper                  = lioadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] target_ip_address              = 192.168.122.53 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] target_port                    = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] target_protocol                = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] target_secondary_ip_addresses  = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] trace_flags                    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] transport_url                  = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] until_refresh                  = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_chap_auth                  = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_default_quota_class        = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_journal                    = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_json                       = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_multipath_for_image_xfer   = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_stderr                     = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] use_syslog                     = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] verify_glance_signatures       = enabled {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_api_class               = cinder.volume.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_backend_name            = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_clear                   = zero {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_clear_ionice            = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_clear_size              = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_copy_bps_limit          = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_dd_blocksize            = 1M {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_name_template           = volume-%s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_service_inithost_offload = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volume_usage_audit_period      = month {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] zoning_mode                    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_concurrency.disable_process_locking = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.auth_section = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.auth_type   = password {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.auth_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.cache       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.certfile    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.include_service_catalog = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.insecure    = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.interface   = public {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.keyfile     = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcache_username = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.region_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.service_token_roles_required = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.service_type = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.backend                  = dogpile.cache.null {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.backend_argument         = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.backend_expiration_time  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.config_prefix            = cache.oslo {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.debug_cache_backend      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.enable_retry_client      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.enable_socket_keepalive  = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.enabled                  = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.expiration_time          = 600 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.hashclient_retry_attempts = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_dead_retry      = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_pool_maxsize    = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_sasl_enabled    = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.password                 = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.proxies                  = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.redis_db                 = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.redis_server             = localhost:6379 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.retry_attempts           = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.retry_delay              = 0.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.socket_keepalive_count   = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.socket_keepalive_idle    = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.socket_keepalive_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.socket_timeout           = 1.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.tls_allowed_ciphers      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.tls_cafile               = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.tls_certfile             = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.tls_enabled              = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.tls_keyfile              = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cache.username                 = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] coordination.backend_url       = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.asyncio_connection    = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.asyncio_slave_connection = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.backend               = sqlalchemy {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.connection            = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.connection_debug      = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.connection_parameters =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.connection_recycle_time = 3600 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.connection_trace      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.db_inc_retry_interval = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.db_max_retries        = 20 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.db_max_retry_interval = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.db_retry_interval     = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.max_overflow          = 50 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.max_pool_size         = 5 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.max_retries           = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.mysql_wsrep_sync_wait = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.pool_timeout          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.retry_interval        = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.slave_connection      = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.sqlite_synchronous    = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.synchronous_reader    = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] database.use_db_reconnect      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack sudo[75687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_tracing.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack sudo[75687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.connection_string     = messaging:// {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.enabled               = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.es_doc_type           = notification {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.es_scroll_size        = 10000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.es_scroll_time        = 2m {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.filter_error_trace    = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.hmac_keys             = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.sentinel_service_name = mymaster {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.socket_timeout        = 0.1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.trace_requests        = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler.trace_sqlalchemy      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler_jaeger.process_tags   = {} {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler_jaeger.service_name_prefix = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] profiler_otlp.service_name_prefix = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.enforce_new_defaults = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.policy_default_rule = default {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.policy_file        = policy.yaml {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.group          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.helper_command = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] privsep_osbrick.user           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.group         = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.helper_command = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] cinder_sys_admin.user          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.auth_section      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.auth_type         = password {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.cafile            = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.certfile          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.collect_timing    = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.insecure          = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.keyfile           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.send_service_user_token = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.split_loggers     = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.timeout           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.tls_ciphers       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] service_user.tls_min_version   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.auth_section            = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.auth_type               = password {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.certfile                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.collect_timing          = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.insecure                = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.keyfile                 = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.region_name             = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.split_loggers           = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.timeout                 = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.tls_ciphers             = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] glance.tls_min_version         = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.backend_availability_zone = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.chap_password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.chap_username =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.disk_geometry = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.driver_client_cert = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.driver_client_cert_key = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.driver_data_namespace = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.driver_use_ssl = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.extra_capabilities = {} {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.filter_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.goodness_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.iscsi_target_flags =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.iscsi_write_cache = on {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.iser_helper   = tgtadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.iser_port     = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.lvm_share_target = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.lvm_type      = auto {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.num_shell_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.replication_device = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.report_discard_supported = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.reserved_percentage = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.target_helper = tgtadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.target_port   = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.target_protocol = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.trace_flags   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.unique_fqdn_network = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.use_chap_auth = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_backend_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_clear  = zero {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_clear_ionice = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_clear_size = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_reports.file_event_handler = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_reports.log_dir           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.backend_host       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.chap_password      = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.chap_username      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.disk_geometry      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.driver_client_cert = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.extra_capabilities = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.filter_function    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.goodness_function  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.iser_helper        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.iser_ip_address    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.iser_port          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.lvm_share_target   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.lvm_type           = auto {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.num_shell_tries    = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.replication_device = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.report_discard_supported = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.reserved_percentage = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.scst_target_driver = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.storage_protocol   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.target_helper      = lioadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.target_ip_address  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.target_port        = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.trace_flags        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.use_chap_auth      = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_clear       = zero {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_clear_size  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] lvmdriver-1.volumes_dir        = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl      = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_notifications.driver = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_notifications.retry = -1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] key_manager.fixed_key          = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.barbican_api_version  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.barbican_endpoint     = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.barbican_endpoint_type = public {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.barbican_region_name  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.cafile                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.certfile              = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.collect_timing        = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.insecure              = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.keyfile               = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.number_of_retries     = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.retry_delay           = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.send_service_user_token = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.split_loggers         = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.timeout               = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.tls_ciphers           = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.tls_min_version       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.verify_ssl            = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican.verify_ssl_path       = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.auth_section = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.auth_type = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.cafile   = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.collect_timing = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.keyfile  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.split_loggers = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.timeout  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.tls_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] barbican_service_user.tls_min_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.approle_role_id          = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.approle_secret_id        = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.auth_method              = approle {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.auth_path                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.kv_mountpoint            = secret {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.kv_path                  = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.kv_version               = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.namespace                = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.root_token_id            = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.ssl_ca_crt_file          = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.timeout                  = 60.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.token_file               = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.token_role               = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.use_ssl                  = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:05:20 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] ******************************************************************************** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 23 00:05:20 devstack sudo[75687]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.366s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack sudo[75819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:20 devstack sudo[75819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:20 devstack sudo[75819]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:05:20 devstack cinder-volume[75634]: INFO cinder.brick.local_dev.lvm [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:21 devstack sudo[75907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:21 devstack sudo[75907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:21 devstack sudo[75907]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:21 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:21 devstack cinder-volume[75634]: DEBUG cinder.brick.local_dev.lvm [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75634) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 23 00:05:21 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:21 devstack sudo[75990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:21 devstack sudo[75990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:22 devstack sudo[75990]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:22 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.712s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:22 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:22 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:22 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:23 devstack sudo[76335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:23 devstack sudo[76335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:23 devstack sudo[76335]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.340s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:23 devstack sudo[76392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 23 00:05:23 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:23 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.305s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:23 devstack sudo[76401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:23 devstack sudo[76401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:23 devstack sudo[76401]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:23 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:23 devstack sudo[76404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:23 devstack sudo[76404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:24 devstack sudo[76404]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:24 devstack sudo[76407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:24 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:24 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:24 devstack sudo[76411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:24 devstack sudo[76411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:24 devstack sudo[76411]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:24 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:24 devstack sudo[76415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:24 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:25 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:25 devstack cinder-volume[75634]: INFO cinder.volume.drivers.lvm [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:25 devstack sudo[76419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:25 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:25 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:25 devstack sudo[76422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:25 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:25 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:25 devstack sudo[76427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:25 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:25 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:25 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:25 devstack sudo[76430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:25 devstack sudo[76430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:26 devstack sudo[76430]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:26 devstack sudo[76433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:26 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:26 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:26 devstack cinder-volume[75634]: INFO cinder.volume.driver [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG cinder.volume.driver [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75634) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75634) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG dbcounter [-] [75634] Writer thread running {{(pid=75634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG cinder.db.api [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Building query based on filter {{(pid=75634) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4221}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG cinder.image.image_utils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75634) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 23 00:05:26 devstack cinder-volume[75634]: INFO cinder.keymgr.migration [None req-fd8ddc0b-f4a7-4d88-b803-e8630fd9ce1f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:26 devstack sudo[76439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:26 devstack sudo[76439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:26 devstack sudo[76439]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:26 devstack sudo[76444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:26 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:27 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:27 devstack sudo[76447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:27 devstack sudo[76447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:27 devstack sudo[76447]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:27 devstack sudo[76450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:27 devstack sudo[76450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:27 devstack sudo[76450]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG cinder.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Notifying Schedulers of capabilities ... {{(pid=75634) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:05:27 devstack cinder-volume[75634]: INFO cinder.volume.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Driver initialization completed successfully.
Sep 23 00:05:27 devstack cinder-volume[75634]: INFO cinder.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Initiating service 2 cleanup
Sep 23 00:05:27 devstack cinder-volume[75634]: INFO cinder.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Service 2 cleanup completed.
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG cinder.service [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Creating RPC server for service cinder-volume {{(pid=75634) start /opt/stack/cinder/cinder/service.py:231}}
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG cinder.service [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75634) start /opt/stack/cinder/cinder/service.py:237}}
Sep 23 00:05:27 devstack cinder-volume[75634]: INFO cinder.volume.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:05:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:27 devstack sudo[76453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:27 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:28 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:28 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:28 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:28 devstack sudo[76457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:28 devstack sudo[76457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:28 devstack sudo[76457]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:28 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:28 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:28 devstack sudo[76460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:28 devstack sudo[76460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:28 devstack sudo[76460]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:28 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:28 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:28 devstack sudo[76468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:28 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:29 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:29 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:29 devstack cinder-volume[75634]: INFO cinder.volume.manager [None req-8dc856e6-ac6d-40f0-ac53-10d613bea76f None None] Driver post RPC initialization completed successfully.
Sep 23 00:05:30 devstack cinder-volume[75464]: DEBUG dbcounter [-] [75464] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:05:39 devstack cinder-volume[75634]: DEBUG dbcounter [-] [75634] Writing DB stats cinder:SELECT=4 {{(pid=75634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:05:39 devstack cinder-volume[75634]: DEBUG dbcounter [-] [75634] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:26 devstack sudo[78434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:06:26 devstack sudo[78434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:26 devstack sudo[78434]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:26 devstack sudo[78437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:06:26 devstack sudo[78437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:26 devstack sudo[78437]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:26 devstack sudo[78440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:06:26 devstack sudo[78440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:26 devstack sudo[78440]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:27 devstack sudo[78475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:06:27 devstack sudo[78475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:27 devstack sudo[78475]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:27 devstack cinder-volume[75634]: DEBUG cinder.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Notifying Schedulers of capabilities ... {{(pid=75634) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:06:27 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager._thread_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:06:27 devstack cinder-volume[75634]: DEBUG cinder.volume.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] thread count: 6 {{(pid=75634) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:06:27 devstack cinder-volume[75634]: DEBUG cinder.volume.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] thread info: [<_MainThread(MainThread, started 139404990226560)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139404879357440)>, <Thread(Thread-3 (stat_writer), started daemon 139404875684032)>, <Thread(Rabbit-heartbeat, started daemon 139404875143424)>, <Thread(Thread-5 (_runner), started daemon 139404875196096)>, <Thread(Thread-7 (_runner), started daemon 139404875352576)>] {{(pid=75634) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:26 devstack sudo[81731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:07:26 devstack sudo[81731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:26 devstack sudo[81731]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:26 devstack sudo[81750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:07:26 devstack sudo[81750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:26 devstack sudo[81750]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:26 devstack sudo[81753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:07:26 devstack sudo[81753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:26 devstack sudo[81753]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:26 devstack sudo[81757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:07:26 devstack sudo[81757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:27 devstack sudo[81757]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:27 devstack cinder-volume[75634]: DEBUG cinder.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Notifying Schedulers of capabilities ... {{(pid=75634) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:07:39 devstack cinder-volume[75634]: DEBUG dbcounter [-] [75634] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:26 devstack sudo[83564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:08:26 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:26 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:26 devstack sudo[83577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:08:26 devstack sudo[83577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:26 devstack sudo[83577]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:26 devstack sudo[83584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:08:26 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:26 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:26 devstack sudo[83603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:08:26 devstack sudo[83603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:27 devstack sudo[83603]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:27 devstack cinder-volume[75634]: DEBUG cinder.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Notifying Schedulers of capabilities ... {{(pid=75634) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:08:27 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager._thread_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:08:27 devstack cinder-volume[75634]: DEBUG cinder.volume.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] thread count: 6 {{(pid=75634) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:08:27 devstack cinder-volume[75634]: DEBUG cinder.volume.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] thread info: [<_MainThread(MainThread, started 139404990226560)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139404879357440)>, <Thread(Thread-3 (stat_writer), started daemon 139404875684032)>, <Thread(Rabbit-heartbeat, started daemon 139404875143424)>, <Thread(Thread-5 (_runner), started daemon 139404875196096)>, <Thread(Thread-7 (_runner), started daemon 139404875352576)>] {{(pid=75634) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG cinder.volume.drivers.lvm [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Updating volume stats {{(pid=75634) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:26 devstack sudo[84796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:09:26 devstack sudo[84796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:26 devstack sudo[84796]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:26 devstack sudo[84821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:09:26 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:26 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:26 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:09:26 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:26 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:26 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:27 devstack sudo[84830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:09:27 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:27 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:27 devstack cinder-volume[75634]: DEBUG oslo_concurrency.processutils [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75634) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:27 devstack cinder-volume[75634]: DEBUG cinder.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Notifying Schedulers of capabilities ... {{(pid=75634) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:09:27 devstack cinder-volume[75634]: DEBUG oslo_service.periodic_task [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] Running periodic task VolumeManager._thread_info {{(pid=75634) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:09:27 devstack cinder-volume[75634]: DEBUG cinder.volume.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] thread count: 6 {{(pid=75634) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:09:27 devstack cinder-volume[75634]: DEBUG cinder.volume.manager [None req-b942dd00-499f-4b85-8898-c1446c521b4b None None] thread info: [<_MainThread(MainThread, started 139404990226560)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139404879357440)>, <Thread(Thread-3 (stat_writer), started daemon 139404875684032)>, <Thread(Rabbit-heartbeat, started daemon 139404875143424)>, <Thread(Thread-5 (_runner), started daemon 139404875196096)>, <Thread(Thread-7 (_runner), started daemon 139404875352576)>] {{(pid=75634) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:09:39 devstack cinder-volume[75634]: DEBUG dbcounter [-] [75634] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:10:11 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Caught SIGTERM, stopping children
Sep 23 00:10:11 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Acquiring lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:10:11 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Acquired lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:10:11 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Releasing lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:10:11 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Stop services. {{(pid=75464) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 23 00:10:11 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Killing children. {{(pid=75464) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 23 00:10:11 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Waiting on 1 children to exit
Sep 23 00:10:12 devstack cinder-volume[75634]: DEBUG oslo_concurrency.lockutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Acquiring lock "singleton_lock" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:10:12 devstack cinder-volume[75634]: DEBUG oslo_concurrency.lockutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Acquired lock "singleton_lock" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:10:12 devstack cinder-volume[75634]: DEBUG oslo_concurrency.lockutils [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Releasing lock "singleton_lock" {{(pid=75634) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:10:12 devstack cinder-volume[75634]: WARNING amqp [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:10:12 devstack cinder-volume[75634]: WARNING amqp [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:10:12 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-d3475db7-3365-49d9-bb8a-315475d59c7e None None] Child 75634 exited with status 0
Sep 23 00:10:13 devstack cinder-volume[86355]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 23 00:10:13 devstack cinder-volume[86355]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:10:13 devstack cinder-volume[86355]: we strongly recommend against using it for new projects.
Sep 23 00:10:13 devstack cinder-volume[86355]: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:10:13 devstack cinder-volume[86355]: framework.  For more detail see
Sep 23 00:10:13 devstack cinder-volume[86355]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:10:13 devstack cinder-volume[86355]:   import eventlet  # noqa
Sep 23 00:10:15 devstack cinder-volume[86355]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:10:15 devstack cinder-volume[86355]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:10:15 devstack cinder-volume[86355]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:10:16 devstack cinder-volume[86355]: INFO dbcounter [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Registered counter for database cinder
Sep 23 00:10:16 devstack cinder-volume[86355]: DEBUG oslo_db.sqlalchemy.engines [None req-d9542785-047a-4704-ade1-f290660ba12a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG dbcounter [-] [86355] Writer thread running {{(pid=86355) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:10:17 devstack cinder-volume[86355]: INFO cinder.rpc [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 00:10:17 devstack cinder-volume[86355]: INFO cinder.rpc [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_db.sqlalchemy.engines [None req-d9542785-047a-4704-ade1-f290660ba12a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:17 devstack cinder-volume[86355]: INFO cinder.volume.manager [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Determined volume DB was empty at startup.
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG cinder.volume.manager [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86355) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 23 00:10:17 devstack cinder-volume[86355]: INFO cinder.volume.manager [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 23 00:10:17 devstack cinder-volume[86355]: WARNING stevedore.named [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:10:17 devstack cinder-volume[86355]: WARNING castellan.key_manager [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:10:17 devstack cinder-volume[86355]: WARNING cinder.keymgr.conf_key_mgr [None req-d9542785-047a-4704-ade1-f290660ba12a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:10:17 devstack cinder-volume[86355]: INFO cinder.volume.manager [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_db.sqlalchemy.engines [None req-d9542785-047a-4704-ade1-f290660ba12a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:17 devstack cinder-volume[86355]: INFO oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Starting 1 workers
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Started child 86627 {{(pid=86355) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Full set of CONF: {{(pid=86355) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] ******************************************************************************** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Configuration options gathered from: {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] ================================================================================ {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] allow_availability_zone_fallback = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86627]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] allow_compression_on_image_upload = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] allowed_direct_url_schemes     = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] api_rate_limit                 = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] auth_strategy                  = keystone {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_availability_zone      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_host                   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_name                   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_stats_polling_interval = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backup_api_class               = cinder.backup.api.API {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backup_name_template           = backup-%s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backup_use_same_host           = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backup_use_temp_snapshot       = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] chap_password                  = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] chap_username                  =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_internal_tenant_project_id = b60553a8bbe246b0808f26924eac5f2d {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_internal_tenant_user_id = 00ac3d052e3e497da4aa09c28fb876e6 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cluster                        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] compression_format             = gzip {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] compute_api_class              = cinder.compute.nova.API {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] config_dir                     = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] config_source                  = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] control_exchange               = openstack {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] debug                          = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] default_availability_zone      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] default_group_type             = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] default_volume_type            = QuobyteHD {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] deployment_max_gigabytes       = -1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] disk_geometry                  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] driver_client_cert             = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] driver_client_cert_key         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] driver_data_namespace          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] driver_ssl_cert_path           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] driver_ssl_cert_verify         = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] driver_use_ssl                 = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] enable_new_services            = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] enable_unsupported_driver      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] enabled_backends               = ['QuobyteHD'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] enforce_multipath_for_image_xfer = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] filter_function                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_api_insecure            = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_api_ssl_compression     = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_ca_certificates_file    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_catalog_info            = image:glance:publicURL {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_certfile                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_keyfile                 = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_num_retries             = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance_request_timeout         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] goodness_function              = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] graceful_shutdown_timeout      = 5 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] group_api_class                = cinder.group.api.API {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] host                           = devstack {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_compress_on_upload       = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_conversion_address_space_limit = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_conversion_cpu_limit     = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_conversion_disable       = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_introspection_address_space_limit = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_introspection_cpu_limit  = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_upload_use_cinder_backend = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_upload_use_internal_tenant = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_volume_cache_enabled     = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_volume_cache_max_count   = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] image_volume_cache_max_size_gb = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] init_host_max_objects_retrieval = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] instance_format                = [instance: %(uuid)s]  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] iscsi_target_flags             =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] iscsi_write_cache              = on {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] iser_helper                    = tgtadm {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] iser_ip_address                = 192.168.122.53 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] iser_port                      = 3260 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_color                      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_config_append              = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_dir                        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_file                       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_options                    = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_rotate_interval            = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_rotate_interval_type       = days {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] log_rotation_type              = none {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86627]: INFO cinder.volume.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.remotefs [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86627) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] max_age                        = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] max_logfile_count              = 30 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] max_logfile_size_mb            = 200 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] max_over_subscription_ratio    = 20.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] message_reap_interval          = 86400 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] message_ttl                    = 2592000 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] migration_create_volume_timeout_secs = 300 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] monkey_patch                   = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] monkey_patch_modules           = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] my_ip                          = 192.168.122.53 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] no_snapshot_gb_quota           = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] num_iser_scan_tries            = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] num_shell_tries                = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] num_volume_device_scan_tries   = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] nvmeof_conn_info_version       = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] nvmet_ns_id                    = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] nvmet_port_id                  = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_max_limit                = 1000 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_volume_ext_list          = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_volume_listen_port       = 8776 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_volume_use_ssl           = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] osapi_volume_workers           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] per_volume_size_limit          = -1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] periodic_fuzzy_delay           = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] periodic_interval              = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] public_endpoint                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] publish_errors                 = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_backup_gigabytes         = 1000 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_backups                  = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_gigabytes                = 1000 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_groups                   = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_snapshots                = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] quota_volumes                  = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] rate_limit_burst               = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] rate_limit_except_level        = CRITICAL {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] rate_limit_interval            = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] reinit_driver_count            = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] replication_device             = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] report_discard_supported       = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] report_interval                = 120 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] reservation_clean_interval     = 86400 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] reservation_expire             = 86400 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] reserved_image_namespaces      = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] reserved_percentage            = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] rpc_response_timeout           = 120 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] run_external_periodic_tasks    = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] scst_target_driver             = iscsi {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] scst_target_iqn_name           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_down_time              = 720 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] shell_completion               = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] snapshot_name_template         = snapshot-%s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] split_loggers                  = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] state_path                     = /opt/stack/data/cinder {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] storage_availability_zone      = nova {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] storage_protocol               = iSCSI {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] syslog_log_facility            = LOG_USER {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] target_helper                  = lioadm {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] target_ip_address              = 192.168.122.53 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] target_port                    = 3260 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] target_protocol                = iscsi {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] target_secondary_ip_addresses  = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] trace_flags                    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] transport_url                  = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] until_refresh                  = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_chap_auth                  = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_default_quota_class        = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_journal                    = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_json                       = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_multipath_for_image_xfer   = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_stderr                     = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] use_syslog                     = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] verify_glance_signatures       = enabled {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_api_class               = cinder.volume.api.API {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_backend_name            = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_clear                   = zero {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_clear_ionice            = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_clear_size              = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_copy_bps_limit          = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_dd_blocksize            = 1M {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_name_template           = volume-%s {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_service_inithost_offload = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volume_usage_audit_period      = month {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] zoning_mode                    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_concurrency.disable_process_locking = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.auth_section = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.auth_type   = password {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.auth_version = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.cache       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.certfile    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.include_service_catalog = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.insecure    = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.interface   = public {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.keyfile     = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_password = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcache_username = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.region_name = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.service_type = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.backend                  = dogpile.cache.null {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.backend_argument         = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.backend_expiration_time  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.config_prefix            = cache.oslo {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.debug_cache_backend      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.enable_retry_client      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.enable_socket_keepalive  = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.enabled                  = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.expiration_time          = 600 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.hashclient_retry_attempts = 2 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_dead_retry      = 300 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_pool_maxsize    = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_sasl_enabled    = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.password                 = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.proxies                  = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86627) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 23 00:10:17 devstack cinder-volume[86627]: WARNING cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 23 00:10:17 devstack cinder-volume[86627]: WARNING cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Running cmd (subprocess): mount.quobyte {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.redis_db                 = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.redis_server             = localhost:6379 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.retry_attempts           = 2 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.retry_delay              = 0.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.socket_keepalive_count   = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.socket_keepalive_idle    = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.socket_keepalive_interval = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.socket_timeout           = 1.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.tls_allowed_ciphers      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.tls_cafile               = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.tls_certfile             = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.tls_enabled              = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.tls_keyfile              = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cache.username                 = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] coordination.backend_url       = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.asyncio_connection    = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.asyncio_slave_connection = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.backend               = sqlalchemy {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.connection            = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.connection_debug      = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.connection_parameters =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.connection_recycle_time = 3600 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.connection_trace      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.db_inc_retry_interval = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.db_max_retries        = 20 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.db_max_retry_interval = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.db_retry_interval     = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.max_overflow          = 50 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.max_pool_size         = 5 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.max_retries           = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.mysql_wsrep_sync_wait = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.pool_timeout          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.retry_interval        = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.slave_connection      = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.sqlite_synchronous    = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.synchronous_reader    = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] database.use_db_reconnect      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_tracing.insecure = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.connection_string     = messaging:// {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.enabled               = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.es_doc_type           = notification {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.es_scroll_size        = 10000 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.es_scroll_time        = 2m {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.filter_error_trace    = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.hmac_keys             = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.sentinel_service_name = mymaster {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.socket_timeout        = 0.1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.trace_requests        = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler.trace_sqlalchemy      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler_jaeger.process_tags   = {} {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler_jaeger.service_name_prefix = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] profiler_otlp.service_name_prefix = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.enforce_new_defaults = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.policy_default_rule = default {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.policy_file        = policy.yaml {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.group          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.helper_command = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] privsep_osbrick.user           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.group         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.helper_command = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] cinder_sys_admin.user          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.auth_section      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.auth_type         = password {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.cafile            = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.certfile          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.collect_timing    = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.insecure          = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.keyfile           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.send_service_user_token = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.split_loggers     = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.timeout           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.tls_ciphers       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] service_user.tls_min_version   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.auth_section            = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.auth_type               = password {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.certfile                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.collect_timing          = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.insecure                = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.keyfile                 = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.region_name             = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.split_loggers           = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.timeout                 = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.tls_ciphers             = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] glance.tls_min_version         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.backend_availability_zone = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.chap_password = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.chap_username =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.disk_geometry = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.driver_client_cert = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.driver_client_cert_key = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.driver_data_namespace = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.driver_use_ssl = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.extra_capabilities = {} {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.filter_function = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.goodness_function = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.iscsi_target_flags =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.iscsi_write_cache = on {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.iser_helper   = tgtadm {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.iser_port     = 3260 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_host      =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_login     = admin {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_mount_options = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_password  = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_private_key =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_share_path =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.num_shell_tries = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.quobyte_volume_url = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.replication_device = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.report_discard_supported = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.reserved_percentage = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.target_helper = tgtadm {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.target_port   = 3260 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.target_protocol = iscsi {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.trace_flags   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.unique_fqdn_network = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.use_chap_auth = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_backend_name = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_clear  = zero {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_clear_ionice = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_clear_size = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_reports.file_event_handler = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_reports.log_dir           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.backend_availability_zone = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.backend_host         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.chap_password        = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.chap_username        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.chiscsi_conf         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.disk_geometry        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.driver_client_cert   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.driver_data_namespace = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.driver_use_ssl       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.extra_capabilities   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack quobyte-client[86637]: Reading configuration file: /etc/quobyte/client.cfg
Sep 23 00:10:17 devstack quobyte-client[86637]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.filter_function      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.goodness_function    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.iser_helper          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.iser_ip_address      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.iser_port            = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.iser_target_prefix   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_host             = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_login            = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_mount_options    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_password         = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_private_key      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_share_path       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_ssh_port         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.num_shell_tries      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.nvmet_port_id        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] CMD "mount.quobyte" returned: 1 in 0.136s {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.replication_device   = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.report_discard_supported = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.reserved_percentage  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.scst_target_driver   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.storage_protocol     = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.target_helper        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.target_ip_address    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.target_port          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=86627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.target_prefix        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.target_protocol      = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.trace_flags          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: INFO cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 ...
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.use_chap_auth        = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_clear         = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_clear_size    = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] QuobyteHD.volumes_dir          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 -c /etc/quobyte/client-cinder.cfg {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl      = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_notifications.driver = [] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_notifications.retry = -1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] key_manager.fixed_key          = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.barbican_api_version  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.barbican_endpoint     = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.barbican_endpoint_type = public {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.barbican_region_name  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.cafile                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.certfile              = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.collect_timing        = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.insecure              = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.keyfile               = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.number_of_retries     = 60 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.retry_delay           = 1 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.send_service_user_token = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.split_loggers         = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.timeout               = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.tls_ciphers           = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.tls_min_version       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.verify_ssl            = True {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican.verify_ssl_path       = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.auth_section = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.auth_type = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.cafile   = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.certfile = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 -c /etc/quobyte/client-cinder.cfg
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.collect_timing = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.insecure = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.keyfile  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.split_loggers = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.timeout  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.tls_ciphers = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] barbican_service_user.tls_min_version = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.approle_role_id          = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.approle_secret_id        = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.auth_method              = approle {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.auth_path                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.kv_mountpoint            = secret {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.kv_path                  = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.kv_version               = 2 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.namespace                = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.root_token_id            = **** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.ssl_ca_crt_file          = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.timeout                  = 60.0 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.token_file               = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.token_role               = None {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.use_ssl                  = False {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:17 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] ******************************************************************************** {{(pid=86355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 23 00:10:18 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.500s {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:18 devstack cinder-volume[86627]: INFO cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 succeeded
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=86627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.517s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:18 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:18 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:18 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.281s {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:18 devstack cinder-volume[86627]: INFO cinder.volume.driver [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG cinder.volume.driver [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86627) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_db.sqlalchemy.engines [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG dbcounter [-] [86627] Writer thread running {{(pid=86627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG cinder.db.api [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Building query based on filter {{(pid=86627) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4221}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG cinder.image.image_utils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86627) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 23 00:10:18 devstack cinder-volume[86627]: INFO cinder.keymgr.migration [None req-b50414c6-e6b0-4bf0-87eb-ced2fd11b527 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=86627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=86627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:18 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:18 devstack sudo[86756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:18 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:19 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.285s {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG cinder.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Notifying Schedulers of capabilities ... {{(pid=86627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:10:19 devstack cinder-volume[86627]: INFO cinder.volume.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Driver initialization completed successfully.
Sep 23 00:10:19 devstack cinder-volume[86627]: INFO cinder.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Initiating service 3 cleanup
Sep 23 00:10:19 devstack cinder-volume[86627]: INFO cinder.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Service 3 cleanup completed.
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG cinder.service [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Creating RPC server for service cinder-volume {{(pid=86627) start /opt/stack/cinder/cinder/service.py:231}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG cinder.service [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86627) start /opt/stack/cinder/cinder/service.py:237}}
Sep 23 00:10:19 devstack cinder-volume[86627]: INFO cinder.volume.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=86627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=86627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:19 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:19 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:19 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:19 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.313s {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:19 devstack cinder-volume[86627]: INFO cinder.volume.manager [None req-ca093e19-fcfd-491d-acfd-2d52b9636bdb None None] Driver post RPC initialization completed successfully.
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=86627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG cinder.volume.drivers.quobyte [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=86627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:25 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:25 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:25 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG oslo_concurrency.processutils [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.260s {{(pid=86627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:25 devstack cinder-volume[86627]: DEBUG cinder.manager [None req-0aafc08b-2525-46b3-94fb-93b9a4000326 None None] Notifying Schedulers of capabilities ... {{(pid=86627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:10:25 devstack cinder-volume[86355]: INFO oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Caught SIGTERM, stopping children
Sep 23 00:10:25 devstack cinder-volume[86355]: DEBUG oslo_concurrency.lockutils [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Acquiring lock "singleton_lock" {{(pid=86355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:10:25 devstack cinder-volume[86355]: DEBUG oslo_concurrency.lockutils [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Acquired lock "singleton_lock" {{(pid=86355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:10:25 devstack cinder-volume[86355]: DEBUG oslo_concurrency.lockutils [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Releasing lock "singleton_lock" {{(pid=86355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:10:25 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Stop services. {{(pid=86355) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 23 00:10:25 devstack cinder-volume[86355]: DEBUG oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Killing children. {{(pid=86355) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 23 00:10:25 devstack cinder-volume[86355]: INFO oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Waiting on 1 children to exit
Sep 23 00:10:27 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Acquiring lock "singleton_lock" {{(pid=86627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:10:27 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Acquired lock "singleton_lock" {{(pid=86627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:10:27 devstack cinder-volume[86627]: DEBUG oslo_concurrency.lockutils [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Releasing lock "singleton_lock" {{(pid=86627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:10:27 devstack cinder-volume[86627]: WARNING amqp [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:10:27 devstack cinder-volume[86627]: WARNING amqp [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:10:27 devstack cinder-volume[86355]: INFO oslo_service.backend._eventlet.service [None req-d9542785-047a-4704-ade1-f290660ba12a None None] Child 86627 exited with status 0
Sep 23 00:10:28 devstack cinder-volume[87023]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 23 00:10:28 devstack cinder-volume[87023]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:10:28 devstack cinder-volume[87023]: we strongly recommend against using it for new projects.
Sep 23 00:10:28 devstack cinder-volume[87023]: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:10:28 devstack cinder-volume[87023]: framework.  For more detail see
Sep 23 00:10:28 devstack cinder-volume[87023]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:10:28 devstack cinder-volume[87023]:   import eventlet  # noqa
Sep 23 00:10:31 devstack cinder-volume[87023]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:10:31 devstack cinder-volume[87023]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:10:31 devstack cinder-volume[87023]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:10:32 devstack cinder-volume[87023]: INFO dbcounter [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Registered counter for database cinder
Sep 23 00:10:32 devstack cinder-volume[87023]: DEBUG oslo_db.sqlalchemy.engines [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:33 devstack cinder-volume[87023]: DEBUG dbcounter [-] [87023] Writer thread running {{(pid=87023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:10:33 devstack cinder-volume[87023]: INFO cinder.rpc [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 00:10:33 devstack cinder-volume[87023]: INFO cinder.rpc [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 00:10:33 devstack cinder-volume[87023]: DEBUG oslo_db.sqlalchemy.engines [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:33 devstack cinder-volume[87023]: INFO cinder.volume.manager [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Determined volume DB was empty at startup.
Sep 23 00:10:33 devstack cinder-volume[87023]: DEBUG cinder.volume.manager [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87023) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 23 00:10:33 devstack cinder-volume[87023]: WARNING stevedore.named [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:10:33 devstack cinder-volume[87023]: WARNING castellan.key_manager [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:10:33 devstack cinder-volume[87023]: WARNING cinder.keymgr.conf_key_mgr [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:10:33 devstack cinder-volume[87023]: INFO cinder.volume.manager [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_db.sqlalchemy.engines [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:34 devstack cinder-volume[87023]: INFO oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Starting 1 workers
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Started child 87293 {{(pid=87023) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Full set of CONF: {{(pid=87023) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] ******************************************************************************** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] Configuration options gathered from: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] ================================================================================ {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] allow_availability_zone_fallback = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] allow_compression_on_image_upload = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] allowed_direct_url_schemes     = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] api_rate_limit                 = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] auth_strategy                  = keystone {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_availability_zone      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_host                   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_name                   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_stats_polling_interval = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backup_api_class               = cinder.backup.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backup_name_template           = backup-%s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backup_use_same_host           = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backup_use_temp_snapshot       = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] chap_password                  = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] chap_username                  =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_internal_tenant_project_id = b60553a8bbe246b0808f26924eac5f2d {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_internal_tenant_user_id = 00ac3d052e3e497da4aa09c28fb876e6 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cluster                        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] compression_format             = gzip {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] config_dir                     = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] config_source                  = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] control_exchange               = openstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] debug                          = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] default_availability_zone      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] default_group_type             = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] default_volume_type            = QuobyteHD {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87293]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] deployment_max_gigabytes       = -1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] disk_geometry                  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] driver_client_cert             = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] driver_client_cert_key         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] driver_data_namespace          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] driver_ssl_cert_path           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] driver_ssl_cert_verify         = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] driver_use_ssl                 = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] enable_new_services            = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] enable_unsupported_driver      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] enforce_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] filter_function                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_api_insecure            = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_api_ssl_compression     = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_ca_certificates_file    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_certfile                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_keyfile                 = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_num_retries             = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance_request_timeout         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] goodness_function              = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] graceful_shutdown_timeout      = 5 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] group_api_class                = cinder.group.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] host                           = devstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_compress_on_upload       = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_conversion_address_space_limit = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_conversion_cpu_limit     = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_conversion_disable       = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_introspection_address_space_limit = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_introspection_cpu_limit  = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_upload_use_cinder_backend = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_upload_use_internal_tenant = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_volume_cache_enabled     = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_volume_cache_max_count   = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] image_volume_cache_max_size_gb = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] init_host_max_objects_retrieval = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] iscsi_target_flags             =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] iscsi_write_cache              = on {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] iser_helper                    = tgtadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] iser_ip_address                = 192.168.122.53 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] iser_port                      = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_color                      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_config_append              = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_dir                        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_file                       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_options                    = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_rotate_interval            = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_rotate_interval_type       = days {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] log_rotation_type              = none {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] max_age                        = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] max_logfile_count              = 30 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] max_logfile_size_mb            = 200 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] max_over_subscription_ratio    = 20.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] message_reap_interval          = 86400 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] message_ttl                    = 2592000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] migration_create_volume_timeout_secs = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] monkey_patch                   = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] monkey_patch_modules           = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] my_ip                          = 192.168.122.53 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] no_snapshot_gb_quota           = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] num_iser_scan_tries            = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] num_shell_tries                = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] num_volume_device_scan_tries   = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] nvmeof_conn_info_version       = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] nvmet_ns_id                    = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] nvmet_port_id                  = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_max_limit                = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_volume_ext_list          = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_volume_listen_port       = 8776 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_volume_use_ssl           = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] osapi_volume_workers           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] per_volume_size_limit          = -1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] periodic_fuzzy_delay           = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] periodic_interval              = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] public_endpoint                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] publish_errors                 = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_backup_gigabytes         = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_backups                  = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_gigabytes                = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_groups                   = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_snapshots                = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] quota_volumes                  = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] rate_limit_burst               = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] rate_limit_except_level        = CRITICAL {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] rate_limit_interval            = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] reinit_driver_count            = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] replication_device             = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] report_discard_supported       = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] report_interval                = 120 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] reservation_clean_interval     = 86400 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] reservation_expire             = 86400 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] reserved_image_namespaces      = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] reserved_percentage            = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] rpc_response_timeout           = 120 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] run_external_periodic_tasks    = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] scst_target_driver             = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] scst_target_iqn_name           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_down_time              = 720 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] shell_completion               = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] snapshot_name_template         = snapshot-%s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] split_loggers                  = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] state_path                     = /opt/stack/data/cinder {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] storage_availability_zone      = nova {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] storage_protocol               = iSCSI {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] syslog_log_facility            = LOG_USER {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] target_helper                  = lioadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] target_ip_address              = 192.168.122.53 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] target_port                    = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] target_protocol                = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87293) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] target_secondary_ip_addresses  = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] trace_flags                    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] transport_url                  = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] until_refresh                  = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_chap_auth                  = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_default_quota_class        = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_journal                    = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_json                       = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_multipath_for_image_xfer   = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_stderr                     = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] use_syslog                     = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] verify_glance_signatures       = enabled {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_api_class               = cinder.volume.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_backend_name            = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_clear                   = zero {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_clear_ionice            = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_clear_size              = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_copy_bps_limit          = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_dd_blocksize            = 1M {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_name_template           = volume-%s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_service_inithost_offload = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volume_usage_audit_period      = month {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] zoning_mode                    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_concurrency.disable_process_locking = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.auth_section = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.auth_type   = password {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.auth_version = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.cache       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.certfile    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.include_service_catalog = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.insecure    = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.interface   = public {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.keyfile     = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcache_username = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.region_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.service_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.backend                  = dogpile.cache.null {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.backend_argument         = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.backend_expiration_time  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.config_prefix            = cache.oslo {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.debug_cache_backend      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.enable_retry_client      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.enable_socket_keepalive  = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.enabled                  = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.expiration_time          = 600 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.hashclient_retry_attempts = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_dead_retry      = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_sasl_enabled    = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.password                 = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.proxies                  = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.redis_db                 = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.redis_server             = localhost:6379 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.retry_attempts           = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.retry_delay              = 0.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.socket_keepalive_count   = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.socket_keepalive_idle    = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.socket_keepalive_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.socket_timeout           = 1.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.tls_allowed_ciphers      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.tls_cafile               = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.tls_certfile             = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.tls_enabled              = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.tls_keyfile              = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cache.username                 = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] coordination.backend_url       = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.asyncio_connection    = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.asyncio_slave_connection = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.backend               = sqlalchemy {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.connection            = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.connection_debug      = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.connection_parameters =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.connection_recycle_time = 3600 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.connection_trace      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.db_inc_retry_interval = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.db_max_retries        = 20 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.db_max_retry_interval = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.db_retry_interval     = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.max_overflow          = 50 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.max_pool_size         = 5 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.max_retries           = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.mysql_wsrep_sync_wait = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.pool_timeout          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.retry_interval        = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.slave_connection      = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.sqlite_synchronous    = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.synchronous_reader    = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] database.use_db_reconnect      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_tracing.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.connection_string     = messaging:// {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.enabled               = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.es_doc_type           = notification {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.es_scroll_size        = 10000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.es_scroll_time        = 2m {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.filter_error_trace    = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.hmac_keys             = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.sentinel_service_name = mymaster {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.socket_timeout        = 0.1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.trace_requests        = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler.trace_sqlalchemy      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler_jaeger.process_tags   = {} {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler_jaeger.service_name_prefix = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] profiler_otlp.service_name_prefix = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.enforce_new_defaults = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.policy_default_rule = default {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.group          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.helper_command = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] privsep_osbrick.user           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.group         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.helper_command = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] cinder_sys_admin.user          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.auth_section      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.auth_type         = password {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.cafile            = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.certfile          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.collect_timing    = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.insecure          = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.keyfile           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.send_service_user_token = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.split_loggers     = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.timeout           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.tls_ciphers       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] service_user.tls_min_version   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.auth_section            = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.auth_type               = password {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.certfile                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.collect_timing          = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.insecure                = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.keyfile                 = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.region_name             = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.split_loggers           = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.timeout                 = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.tls_ciphers             = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] glance.tls_min_version         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.backend_availability_zone = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.chap_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.chap_username =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.disk_geometry = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.driver_client_cert = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.driver_client_cert_key = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.driver_data_namespace = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.driver_use_ssl = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.extra_capabilities = {} {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.filter_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.goodness_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.iscsi_target_flags =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.iscsi_write_cache = on {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.iser_port     = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_host      =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_login     = admin {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_mount_options = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_password  = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_private_key =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_share_path =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.num_shell_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.quobyte_volume_url = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.replication_device = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.report_discard_supported = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.reserved_percentage = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.target_helper = tgtadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87293) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 23 00:10:34 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 23 00:10:34 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Running cmd (subprocess): mount.quobyte {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.target_port   = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.target_protocol = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.trace_flags   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.unique_fqdn_network = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.use_chap_auth = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_backend_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_clear  = zero {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_clear_ionice = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_clear_size = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_reports.file_event_handler = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_reports.log_dir           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.backend_availability_zone = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.backend_host         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.chap_password        = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.chap_username        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.disk_geometry        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.driver_client_cert   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.driver_data_namespace = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.extra_capabilities   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.filter_function      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.goodness_function    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.iser_helper          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.iser_ip_address      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.iser_port            = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_host             = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_login            = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_mount_options    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_password         = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_private_key      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_share_path       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack quobyte-client[87294]: Reading configuration file: /etc/quobyte/client.cfg
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.num_shell_tries      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack quobyte-client[87294]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.replication_device   = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.report_discard_supported = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.reserved_percentage  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.scst_target_driver   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.storage_protocol     = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.target_helper        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.target_ip_address    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.target_port          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.target_prefix        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.target_protocol      = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.trace_flags          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.use_chap_auth        = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_clear         = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_clear_size    = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] QuobyteHD.volumes_dir          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack sudo[87295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_notifications.driver = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_notifications.retry = -1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] key_manager.fixed_key          = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.barbican_api_version  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.barbican_endpoint     = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.barbican_endpoint_type = public {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.barbican_region_name  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.cafile                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.certfile              = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.collect_timing        = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.insecure              = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.keyfile               = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.number_of_retries     = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.retry_delay           = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.send_service_user_token = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.split_loggers         = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.timeout               = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.tls_ciphers           = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.tls_min_version       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.verify_ssl            = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican.verify_ssl_path       = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.auth_section = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.auth_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.cafile   = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.collect_timing = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.keyfile  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.split_loggers = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.timeout  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.tls_ciphers = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] barbican_service_user.tls_min_version = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.approle_role_id          = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.approle_secret_id        = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.auth_method              = approle {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.auth_path                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.kv_mountpoint            = secret {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.kv_path                  = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.kv_version               = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.namespace                = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.root_token_id            = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.ssl_ca_crt_file          = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.timeout                  = 60.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.token_file               = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.token_role               = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.use_ssl                  = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:10:34 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-f1289ef8-8e34-44f1-98a6-aabf0a9b37d8 None None] ******************************************************************************** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 23 00:10:34 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.355s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:34 devstack cinder-volume[87293]: INFO cinder.volume.driver [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 00:10:34 devstack cinder-volume[87293]: DEBUG cinder.volume.driver [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87293) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_db.sqlalchemy.engines [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writer thread running {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.db.api [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Building query based on filter {{(pid=87293) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4221}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87293) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:35 devstack cinder-volume[87293]: INFO cinder.keymgr.migration [None req-888d2223-857b-45ea-9622-e99f11ae5ffe None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 00:10:35 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:35 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:35 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.292s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:10:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Driver initialization completed successfully.
Sep 23 00:10:35 devstack cinder-volume[87293]: INFO cinder.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Initiating service 3 cleanup
Sep 23 00:10:35 devstack cinder-volume[87293]: INFO cinder.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Service 3 cleanup completed.
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.service [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Creating RPC server for service cinder-volume {{(pid=87293) start /opt/stack/cinder/cinder/service.py:231}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.service [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87293) start /opt/stack/cinder/cinder/service.py:237}}
Sep 23 00:10:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:35 devstack sudo[87305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:10:35 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:35 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.333s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f97bf2b7-7eaa-4fbf-96b8-02c47cc2b50f None None] Driver post RPC initialization completed successfully.
Sep 23 00:10:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:10:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 6 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:10:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:10:44 devstack cinder-volume[87023]: DEBUG dbcounter [-] [87023] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:10:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:10:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:39 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:11:39 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:40 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.422s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:11:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:11:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 6 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:11:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Flow 'volume_create_manager' (738daf22-dc2d-4bed-b5a2-1e8c51385a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9c61e3-1bf2-4fdd-8a94-6f9cd1f0f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9c61e3-1bf2-4fdd-8a94-6f9cd1f0f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-810254594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018140ab-5d5a-41db-a00c-29385517e99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21137b29524a4c3eab37d561cd0ed42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:49Z,use_quota=True,user_id='04ac1bb8d2f74799bb3132ed3434b22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b8044-fd6e-4d8b-aea2-3379b41c133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b8044-fd6e-4d8b-aea2-3379b41c133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffaccc5-0ece-4734-835d-767decebfbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffaccc5-0ece-4734-835d-767decebfbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018140ab-5d5a-41db-a00c-29385517e99d', 'volume_name': 'volume-018140ab-5d5a-41db-a00c-29385517e99d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2e342a-8b77-4cf7-b388-1389bc22f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2e342a-8b77-4cf7-b388-1389bc22f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b8e06a-850c-4e90-913a-a1373f7750aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:49 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Volume 018140ab-5d5a-41db-a00c-29385517e99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018140ab-5d5a-41db-a00c-29385517e99d', 'volume_size': 1}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-810254594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018140ab-5d5a-41db-a00c-29385517e99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21137b29524a4c3eab37d561cd0ed42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:49Z,use_quota=True,user_id='04ac1bb8d2f74799bb3132ed3434b22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Creating volume 018140ab-5d5a-41db-a00c-29385517e99d {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:11:49 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:11:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:49 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d 1073741824
Sep 23 00:11:49 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:51 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d 1073741824" returned: 0 in 2.084s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:52 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d
Sep 23 00:11:52 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:52 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d" returned: 0 in 0.731s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] <== create_volume: return (3017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b8e06a-850c-4e90-913a-a1373f7750aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018140ab-5d5a-41db-a00c-29385517e99d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c2f2f7-31f1-4d5c-acc7-d1b9079e00f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Volume volume-018140ab-5d5a-41db-a00c-29385517e99d (018140ab-5d5a-41db-a00c-29385517e99d): created successfully
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c2f2f7-31f1-4d5c-acc7-d1b9079e00f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Flow 'volume_create_manager' (738daf22-dc2d-4bed-b5a2-1e8c51385a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:52 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-750ba9cc-0bf6-4836-856f-50d38f9036ec tempest-DeleteServersTestJSON-712130773 None] Created volume successfully.
Sep 23 00:12:00 devstack cinder-volume[87293]: WARNING py.warnings [req-ea89fc18-60ad-44d0-92e5-7c3c3e709067 req-6e3b89f3-8a36-4df1-aaf5-c6af0ad8bd08 tempest-DeleteServersTestJSON-712130773 None] /opt/stack/cinder/cinder/db/api.py:2747: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 23 00:12:00 devstack cinder-volume[87293]:   .first()
Sep 23 00:12:00 devstack cinder-volume[87293]: 
Sep 23 00:12:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ea89fc18-60ad-44d0-92e5-7c3c3e709067 req-6e3b89f3-8a36-4df1-aaf5-c6af0ad8bd08 tempest-DeleteServersTestJSON-712130773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ea89fc18-60ad-44d0-92e5-7c3c3e709067 req-6e3b89f3-8a36-4df1-aaf5-c6af0ad8bd08 tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ea89fc18-60ad-44d0-92e5-7c3c3e709067 req-6e3b89f3-8a36-4df1-aaf5-c6af0ad8bd08 tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-ea89fc18-60ad-44d0-92e5-7c3c3e709067 req-6e3b89f3-8a36-4df1-aaf5-c6af0ad8bd08 tempest-DeleteServersTestJSON-712130773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-018140ab-5d5a-41db-a00c-29385517e99d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d238694-617a-4975-bf49-dc724582acbf', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:12:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-ea89fc18-60ad-44d0-92e5-7c3c3e709067 req-6e3b89f3-8a36-4df1-aaf5-c6af0ad8bd08 tempest-DeleteServersTestJSON-712130773 None] attachment_update completed successfully.
Sep 23 00:12:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-06986144-ccad-4ec2-a037-9994ecdc2391 req-20a247fd-619f-4da0-8dfd-9b4b44e494fa tempest-DeleteServersTestJSON-712130773 None] Terminate volume connection completed successfully.
Sep 23 00:12:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-06986144-ccad-4ec2-a037-9994ecdc2391 req-20a247fd-619f-4da0-8dfd-9b4b44e494fa tempest-DeleteServersTestJSON-712130773 None] Deleting attachment 7d238694-617a-4975-bf49-dc724582acbf. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:12:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Acquiring lock "cinder-018140ab-5d5a-41db-a00c-29385517e99d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Lock "cinder-018140ab-5d5a-41db-a00c-29385517e99d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Acquiring lock "cinder-quobyte-018140ab-5d5a-41db-a00c-29385517e99d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Lock "cinder-quobyte-018140ab-5d5a-41db-a00c-29385517e99d" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:12 devstack cinder-volume[87293]: INFO oslo.privsep.daemon [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa3v98gdq/privsep.sock']
Sep 23 00:12:12 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa3v98gdq/privsep.sock
Sep 23 00:12:12 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 23 00:12:13 devstack cinder-volume[87293]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 23 00:12:14 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:14 devstack cinder-volume[87293]: INFO oslo.privsep.daemon [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Spawned new privsep daemon via rootwrap
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Accepted privsep connection to /tmp/tmpa3v98gdq/privsep.sock {{(pid=87293) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 23 00:12:14 devstack cinder-volume[87293]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 23 00:12:14 devstack cinder-volume[87293]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 23 00:12:14 devstack cinder-volume[87293]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 23 00:12:14 devstack cinder-volume[87293]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88813
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65409275-c1c5-470e-a732-5a39b8df777c]: (2,) {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a1f116-7c54-41ab-a32e-cdb64eaaecec]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:14 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d
Sep 23 00:12:14 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:14 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d" returned: 0 in 0.509s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:14 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d
Sep 23 00:12:14 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:14 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-018140ab-5d5a-41db-a00c-29385517e99d" returned: 0 in 0.369s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Lock "cinder-quobyte-018140ab-5d5a-41db-a00c-29385517e99d" released by "delete_volume" :: held 2.341s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:15 devstack cinder-volume[87293]: WARNING cinder.quota [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:15 devstack cinder-volume[87293]: WARNING cinder.quota [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Created reservations ['e2b5c9b9-f834-4ec1-8ff4-127b26f2a142', '1543ae65-c186-4260-979b-1b3b684ea9ee', 'b1338185-f27a-4b80-8f9c-6f28fb7726b0', 'adf24bbf-c3e9-4099-b948-c6425d5851bf', '3d4160fa-31bc-420e-8e93-8685bc49041a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:15 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:12:15 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:15 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.285s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Deleted volume successfully.
Sep 23 00:12:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-300323a3-c98c-4431-b95e-040f4907434f tempest-DeleteServersTestJSON-712130773 None] Lock "cinder-018140ab-5d5a-41db-a00c-29385517e99d-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Flow 'volume_create_manager' (51932e99-f351-4127-a4a8-57245c85bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208c9bb7-37c4-4bc9-a40d-924352301422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208c9bb7-37c4-4bc9-a40d-924352301422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1787747141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a37dbca-0b23-4cd4-9ee6-9eaffb687f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955ae77e7a4940ee8ebf81b6f0d48558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:24Z,use_quota=True,user_id='37232f44016d4f849a9f715ff8c31408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a2ec4b-86c7-49cd-8d8f-68d5ef9a8b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a2ec4b-86c7-49cd-8d8f-68d5ef9a8b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f38f029-b69d-4415-9c1e-0e33668e66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f38f029-b69d-4415-9c1e-0e33668e66a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a37dbca-0b23-4cd4-9ee6-9eaffb687f36', 'volume_name': 'volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f225ef3-2b0c-4485-ad25-b6bcaa3427e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f225ef3-2b0c-4485-ad25-b6bcaa3427e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb686a2-1fcc-492f-ad0b-dc3d0c0626dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:24 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Volume 6a37dbca-0b23-4cd4-9ee6-9eaffb687f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36', 'volume_size': 1}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1787747141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a37dbca-0b23-4cd4-9ee6-9eaffb687f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955ae77e7a4940ee8ebf81b6f0d48558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:24Z,use_quota=True,user_id='37232f44016d4f849a9f715ff8c31408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Creating volume 6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:24 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:12:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:24 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 1073741824
Sep 23 00:12:24 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:25 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 1073741824" returned: 0 in 0.661s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:25 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36
Sep 23 00:12:25 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:25 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36" returned: 0 in 0.383s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb686a2-1fcc-492f-ad0b-dc3d0c0626dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a91301-c9eb-4b8b-82f4-0eccae76d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:25 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Volume volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 (6a37dbca-0b23-4cd4-9ee6-9eaffb687f36): created successfully
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a91301-c9eb-4b8b-82f4-0eccae76d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Flow 'volume_create_manager' (51932e99-f351-4127-a4a8-57245c85bd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fe5218de-ecc3-4052-bc28-0a65728e8ed3 tempest-ServerActionsTestOtherA-1389854590 None] Created volume successfully.
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Flow 'volume_create_manager' (58ea3908-2295-4907-bd37-14678de16778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75703ad2-9cd2-4e33-a00c-1224a56ed2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75703ad2-9cd2-4e33-a00c-1224a56ed2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1227334487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169af4b5-0401-4b03-9bfb-8817c0839148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73691dd3ca84dc98081f03b55f82f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:32Z,use_quota=True,user_id='7b3b8c0b71cc4e55a0c66653244ea82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ecc107-c7c8-4f39-85bc-8c80c8a8ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ecc107-c7c8-4f39-85bc-8c80c8a8ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6167c0e-f95e-4010-86be-bc5d08a8fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6167c0e-f95e-4010-86be-bc5d08a8fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '169af4b5-0401-4b03-9bfb-8817c0839148', 'volume_name': 'volume-169af4b5-0401-4b03-9bfb-8817c0839148', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e0962c-2c13-4547-aa14-8eab667b8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e0962c-2c13-4547-aa14-8eab667b8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4b7719-3fe0-415c-89a1-7b5643371b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Volume 169af4b5-0401-4b03-9bfb-8817c0839148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-169af4b5-0401-4b03-9bfb-8817c0839148', 'volume_size': 1}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1227334487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169af4b5-0401-4b03-9bfb-8817c0839148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73691dd3ca84dc98081f03b55f82f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:32Z,use_quota=True,user_id='7b3b8c0b71cc4e55a0c66653244ea82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Creating volume 169af4b5-0401-4b03-9bfb-8817c0839148 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:31 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:12:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:31 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148 1073741824
Sep 23 00:12:31 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:32 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148 1073741824" returned: 0 in 0.558s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:32 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148
Sep 23 00:12:32 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:32 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148" returned: 0 in 0.499s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4b7719-3fe0-415c-89a1-7b5643371b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169af4b5-0401-4b03-9bfb-8817c0839148', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d1a0e7-ab1f-4013-bc04-09e5df936b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Volume volume-169af4b5-0401-4b03-9bfb-8817c0839148 (169af4b5-0401-4b03-9bfb-8817c0839148): created successfully
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d1a0e7-ab1f-4013-bc04-09e5df936b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Flow 'volume_create_manager' (58ea3908-2295-4907-bd37-14678de16778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:32 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d438a503-d649-4872-a561-481a59df3f1b tempest-AttachVolumeTestJSON-15973201 None] Created volume successfully.
Sep 23 00:12:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-f5699ef2-9378-4b8d-a1e7-addeacb9f900 req-197af0ce-38f4-44f6-a3b7-6170a058c5b1 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-f5699ef2-9378-4b8d-a1e7-addeacb9f900 req-197af0ce-38f4-44f6-a3b7-6170a058c5b1 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-f5699ef2-9378-4b8d-a1e7-addeacb9f900 req-197af0ce-38f4-44f6-a3b7-6170a058c5b1 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-f5699ef2-9378-4b8d-a1e7-addeacb9f900 req-197af0ce-38f4-44f6-a3b7-6170a058c5b1 tempest-AttachVolumeTestJSON-15973201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-169af4b5-0401-4b03-9bfb-8817c0839148', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97b40360-1b19-456b-9f1f-26cee0b0e79a', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:12:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-f5699ef2-9378-4b8d-a1e7-addeacb9f900 req-197af0ce-38f4-44f6-a3b7-6170a058c5b1 tempest-AttachVolumeTestJSON-15973201 None] attachment_update completed successfully.
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:39 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:12:39 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:40 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.445s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=29,cinder:INSERT=4,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:12:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=22,cinder:SELECT=24,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:13:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ebee8c12-aae4-4814-9a3b-a1c2024c9922 req-1aa104b7-7b22-4185-ae37-edf5fd1c9787 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ebee8c12-aae4-4814-9a3b-a1c2024c9922 req-1aa104b7-7b22-4185-ae37-edf5fd1c9787 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ebee8c12-aae4-4814-9a3b-a1c2024c9922 req-1aa104b7-7b22-4185-ae37-edf5fd1c9787 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-ebee8c12-aae4-4814-9a3b-a1c2024c9922 req-1aa104b7-7b22-4185-ae37-edf5fd1c9787 tempest-ServerActionsTestOtherA-1389854590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c106fa94-2964-44f1-a917-d6c3a6b9ce7f', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:13:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-ebee8c12-aae4-4814-9a3b-a1c2024c9922 req-1aa104b7-7b22-4185-ae37-edf5fd1c9787 tempest-ServerActionsTestOtherA-1389854590 None] attachment_update completed successfully.
Sep 23 00:13:28 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-6906fa45-63b5-42cc-8def-fd90e47a7814 tempest-ServerActionsTestOtherA-1389854590 None] Terminate volume connection completed successfully.
Sep 23 00:13:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-6906fa45-63b5-42cc-8def-fd90e47a7814 tempest-ServerActionsTestOtherA-1389854590 None] Deleting attachment c106fa94-2964-44f1-a917-d6c3a6b9ce7f. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:13:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-192c9155-b3aa-425c-b7e0-3bb0a6d6fa33 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-192c9155-b3aa-425c-b7e0-3bb0a6d6fa33 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-192c9155-b3aa-425c-b7e0-3bb0a6d6fa33 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-192c9155-b3aa-425c-b7e0-3bb0a6d6fa33 tempest-ServerActionsTestOtherA-1389854590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cf5ede3-4633-48bf-a530-67fccd19e61b', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:13:30 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-ddd8a5e3-e713-4a2a-82e6-7c333eda21fc req-192c9155-b3aa-425c-b7e0-3bb0a6d6fa33 tempest-ServerActionsTestOtherA-1389854590 None] attachment_update completed successfully.
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Flow 'volume_create_manager' (3820e9e7-07d6-4121-a0ad-ddee5b125831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16e632-c0da-4b46-aadf-3c318a89b0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16e632-c0da-4b46-aadf-3c318a89b0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1982194850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0beee43-25fc-4033-bb4d-64af3d9d046d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce43ef1619f4e649d50d58bfb7ef010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:31Z,use_quota=True,user_id='c6fc5c58f35c4fb3acbd82fef2a10f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20fafd1-a927-433b-af89-720d5e514344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20fafd1-a927-433b-af89-720d5e514344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721a85ef-8359-4244-88bf-3dbdb0ea6330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721a85ef-8359-4244-88bf-3dbdb0ea6330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0beee43-25fc-4033-bb4d-64af3d9d046d', 'volume_name': 'volume-b0beee43-25fc-4033-bb4d-64af3d9d046d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d68825-6022-4304-94ef-843139fc9259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d68825-6022-4304-94ef-843139fc9259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d41782-0e07-4923-b63f-1c55c3db398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Volume b0beee43-25fc-4033-bb4d-64af3d9d046d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0beee43-25fc-4033-bb4d-64af3d9d046d', 'volume_size': 1}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1982194850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0beee43-25fc-4033-bb4d-64af3d9d046d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce43ef1619f4e649d50d58bfb7ef010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:31Z,use_quota=True,user_id='c6fc5c58f35c4fb3acbd82fef2a10f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Creating volume b0beee43-25fc-4033-bb4d-64af3d9d046d {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:31 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:13:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:31 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d 1073741824
Sep 23 00:13:31 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:32 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d 1073741824" returned: 0 in 0.894s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:32 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d
Sep 23 00:13:32 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:33 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d" returned: 0 in 0.457s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d41782-0e07-4923-b63f-1c55c3db398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0beee43-25fc-4033-bb4d-64af3d9d046d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d3be7d-86c4-40a0-9571-f01c458a66b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Volume volume-b0beee43-25fc-4033-bb4d-64af3d9d046d (b0beee43-25fc-4033-bb4d-64af3d9d046d): created successfully
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d3be7d-86c4-40a0-9571-f01c458a66b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Flow 'volume_create_manager' (3820e9e7-07d6-4121-a0ad-ddee5b125831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-036f54d1-0146-4ab3-916c-56d05e44d09c tempest-ServersNegativeTestJSON-1072207389 None] Created volume successfully.
Sep 23 00:13:37 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-7424895f-0252-4967-97fe-261d667f2dd6 req-877c33c2-65d1-4239-a7d9-c80cf22c1297 tempest-AttachVolumeTestJSON-15973201 None] Terminate volume connection completed successfully.
Sep 23 00:13:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-7424895f-0252-4967-97fe-261d667f2dd6 req-877c33c2-65d1-4239-a7d9-c80cf22c1297 tempest-AttachVolumeTestJSON-15973201 None] Deleting attachment 97b40360-1b19-456b-9f1f-26cee0b0e79a. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:40 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:13:40 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Flow 'volume_create_manager' (b19aed55-b323-439e-a689-48b14217cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f9de4c-5498-4a87-8284-a8d3e07741e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f9de4c-5498-4a87-8284-a8d3e07741e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-203896118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f832045-c4d7-427c-b5e7-9ab6666faf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce43ef1619f4e649d50d58bfb7ef010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:40Z,use_quota=True,user_id='c6fc5c58f35c4fb3acbd82fef2a10f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657b6e29-c0d0-454c-8e6d-8a52350175fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657b6e29-c0d0-454c-8e6d-8a52350175fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f29741-7a92-4f4a-b772-008aad818808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f29741-7a92-4f4a-b772-008aad818808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f832045-c4d7-427c-b5e7-9ab6666faf39', 'volume_name': 'volume-4f832045-c4d7-427c-b5e7-9ab6666faf39', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02fe007-c9f6-4fa4-8ac3-021556915887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02fe007-c9f6-4fa4-8ac3-021556915887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619c4bfb-9f90-4c1c-abd9-67dfeaf2c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:40 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Volume 4f832045-c4d7-427c-b5e7-9ab6666faf39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f832045-c4d7-427c-b5e7-9ab6666faf39', 'volume_size': 1}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-203896118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f832045-c4d7-427c-b5e7-9ab6666faf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce43ef1619f4e649d50d58bfb7ef010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:40Z,use_quota=True,user_id='c6fc5c58f35c4fb3acbd82fef2a10f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Creating volume 4f832045-c4d7-427c-b5e7-9ab6666faf39 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:40 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:40 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 1073741824
Sep 23 00:13:40 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:40 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.822s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 8 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:13:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:13:41 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 1073741824" returned: 0 in 0.942s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:41 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39
Sep 23 00:13:41 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:42 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39" returned: 0 in 0.647s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619c4bfb-9f90-4c1c-abd9-67dfeaf2c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f832045-c4d7-427c-b5e7-9ab6666faf39', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70989e5d-8c06-4030-b675-a9c973005983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Volume volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 (4f832045-c4d7-427c-b5e7-9ab6666faf39): created successfully
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70989e5d-8c06-4030-b675-a9c973005983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Flow 'volume_create_manager' (b19aed55-b323-439e-a689-48b14217cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0c821eae-0d04-4094-b33d-e362fc09fa15 tempest-ServersNegativeTestJSON-1072207389 None] Created volume successfully.
Sep 23 00:13:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "cinder-4f832045-c4d7-427c-b5e7-9ab6666faf39-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-4f832045-c4d7-427c-b5e7-9ab6666faf39-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "cinder-quobyte-4f832045-c4d7-427c-b5e7-9ab6666faf39" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-quobyte-4f832045-c4d7-427c-b5e7-9ab6666faf39" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf3aa53-d7b3-4b0a-b972-e3fe87f4eb2e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:45 devstack sudo[90476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39
Sep 23 00:13:45 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:46 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39" returned: 0 in 1.001s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:46 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39
Sep 23 00:13:46 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:47 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f832045-c4d7-427c-b5e7-9ab6666faf39" returned: 0 in 1.006s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-quobyte-4f832045-c4d7-427c-b5e7-9ab6666faf39" released by "delete_volume" :: held 2.145s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Created reservations ['b6fe6fb6-8d9b-437c-b35e-440dc40aa0b2', '75131ae5-66a6-4585-abdd-a3a46cabfead', 'a91df226-e0b9-4453-b237-00c2292d0f00', '3b906680-ec6c-4dfd-864d-b16d230c0596', '430f5afe-4599-4071-9aec-f81e9518458e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:47 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:13:47 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "cinder-b0beee43-25fc-4033-bb4d-64af3d9d046d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:48 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.684s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Deleted volume successfully.
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-b0beee43-25fc-4033-bb4d-64af3d9d046d-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c33f428f-ab90-4f79-b969-209034fb8a98 tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-4f832045-c4d7-427c-b5e7-9ab6666faf39-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "cinder-quobyte-b0beee43-25fc-4033-bb4d-64af3d9d046d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-quobyte-b0beee43-25fc-4033-bb4d-64af3d9d046d" acquired by "delete_volume" :: waited 0.101s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c1458-4de8-4c0a-b916-aff93a865d11]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:49 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d
Sep 23 00:13:49 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:49 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d" returned: 0 in 0.787s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:49 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d
Sep 23 00:13:49 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:50 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b0beee43-25fc-4033-bb4d-64af3d9d046d" returned: 0 in 0.400s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-quobyte-b0beee43-25fc-4033-bb4d-64af3d9d046d" released by "delete_volume" :: held 1.365s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Created reservations ['b7be3979-599f-4ed7-91cc-ee29efe1460a', '0ce83732-aab4-4fcf-bc4f-59206430b255', 'ecca9fd6-1638-4c75-9424-7a37632ac9ef', 'a67241c9-5706-405d-9ff6-881073d1e945', 'c0efbd31-728f-4cfa-bd78-2f93544c86ad'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:50 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:13:50 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:50 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.339s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Deleted volume successfully.
Sep 23 00:13:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-82e8e05d-0049-4d6a-980b-4fe2b3353ceb tempest-ServersNegativeTestJSON-1072207389 None] Lock "cinder-b0beee43-25fc-4033-bb4d-64af3d9d046d-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Flow 'volume_create_manager' (a7e71cd7-70f4-4587-ad70-c204efae302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e45ea7-49be-4bdb-8869-56700b90c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e45ea7-49be-4bdb-8869-56700b90c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1835683522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094303a1-f487-43e9-8f61-436de5f2c43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8542e1486f114020a37ef2b2d4d45d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:59Z,use_quota=True,user_id='db61c286b63341e9a77db3c032eb325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baafc999-bc4f-4dfb-a21f-944b7782629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baafc999-bc4f-4dfb-a21f-944b7782629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa164cb-ba26-4812-a8c4-656842a17612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa164cb-ba26-4812-a8c4-656842a17612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094303a1-f487-43e9-8f61-436de5f2c43e', 'volume_name': 'volume-094303a1-f487-43e9-8f61-436de5f2c43e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699496a0-eaae-464d-b2ac-ee4ecb8074bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699496a0-eaae-464d-b2ac-ee4ecb8074bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be66beb-3305-45ec-bff4-de7b2a363eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Volume 094303a1-f487-43e9-8f61-436de5f2c43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094303a1-f487-43e9-8f61-436de5f2c43e', 'volume_size': 1}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1835683522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094303a1-f487-43e9-8f61-436de5f2c43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8542e1486f114020a37ef2b2d4d45d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:59Z,use_quota=True,user_id='db61c286b63341e9a77db3c032eb325b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Creating volume 094303a1-f487-43e9-8f61-436de5f2c43e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:59 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:13:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:59 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e 1073741824
Sep 23 00:13:59 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:00 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e 1073741824" returned: 0 in 0.907s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:00 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e
Sep 23 00:14:00 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:00 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be66beb-3305-45ec-bff4-de7b2a363eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094303a1-f487-43e9-8f61-436de5f2c43e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183552d4-55bb-457c-86e8-aa4dab0c8e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Volume volume-094303a1-f487-43e9-8f61-436de5f2c43e (094303a1-f487-43e9-8f61-436de5f2c43e): created successfully
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183552d4-55bb-457c-86e8-aa4dab0c8e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Flow 'volume_create_manager' (a7e71cd7-70f4-4587-ad70-c204efae302c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f77152f5-13e6-4009-aa7a-802a989df90a tempest-VolumesAdminNegativeTest-654781818 None] Created volume successfully.
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Acquiring lock "cinder-094303a1-f487-43e9-8f61-436de5f2c43e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Lock "cinder-094303a1-f487-43e9-8f61-436de5f2c43e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Acquiring lock "cinder-quobyte-094303a1-f487-43e9-8f61-436de5f2c43e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Lock "cinder-quobyte-094303a1-f487-43e9-8f61-436de5f2c43e" acquired by "delete_volume" :: waited 0.052s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[748feeae-588e-430d-ab0e-8f2aa3e6891f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:02 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e
Sep 23 00:14:02 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-f9919de7-8c73-4e4b-90e8-117e5ada44f6 req-4ecc317e-558d-4b9b-946e-bfd5f2ec7285 tempest-ServerActionsTestOtherA-1389854590 None] Terminate volume connection completed successfully.
Sep 23 00:14:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-f9919de7-8c73-4e4b-90e8-117e5ada44f6 req-4ecc317e-558d-4b9b-946e-bfd5f2ec7285 tempest-ServerActionsTestOtherA-1389854590 None] Deleting attachment 9cf5ede3-4633-48bf-a530-67fccd19e61b. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:14:03 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e" returned: 0 in 1.112s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:03 devstack sudo[90741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e
Sep 23 00:14:03 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:04 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-094303a1-f487-43e9-8f61-436de5f2c43e" returned: 0 in 0.672s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Lock "cinder-quobyte-094303a1-f487-43e9-8f61-436de5f2c43e" released by "delete_volume" :: held 1.992s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Created reservations ['5d2fd156-bfcd-41cb-83c4-7bf3a39a0351', '31b30e47-2fd9-4976-a32d-af813650b755', '1a67503e-f420-45d0-be48-814579959eb3', '57b3dcb3-2f7d-4b06-97d3-a4c75f37cba7', 'e3f37eac-80f8-43de-81a0-58f808259ce8'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:04 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:14:04 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:05 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.771s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:05 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Deleted volume successfully.
Sep 23 00:14:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a11313bd-b20d-4951-97f5-6e33be3029ee tempest-VolumesAdminNegativeTest-654781818 None] Lock "cinder-094303a1-f487-43e9-8f61-436de5f2c43e-delete_volume" released by "delete_volume" :: held 3.644s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Flow 'volume_create_manager' (acf4fd93-4a0a-4b29-9dbf-94113d6fbd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74974d6e-d0cc-4614-9178-3a348f1960ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74974d6e-d0cc-4614-9178-3a348f1960ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1895290199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335ba6c3-6430-4c41-8b39-b6b01ab91ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955ae77e7a4940ee8ebf81b6f0d48558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:15Z,use_quota=True,user_id='37232f44016d4f849a9f715ff8c31408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8347b6f0-28c3-4cb6-9e88-cbd1b9a40223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8347b6f0-28c3-4cb6-9e88-cbd1b9a40223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4390369f-16f6-4ce9-987c-857f805e2428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:14 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:14:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4390369f-16f6-4ce9-987c-857f805e2428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '335ba6c3-6430-4c41-8b39-b6b01ab91ee4', 'volume_name': 'volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf2281d0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6213eaf-4598-46de-b18d-d9f98fa580b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6213eaf-4598-46de-b18d-d9f98fa580b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01dde6b-b4fd-4317-9b54-b7f563205eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Volume 335ba6c3-6430-4c41-8b39-b6b01ab91ee4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf2281d0>}
Sep 23 00:14:15 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Trying to clone 335ba6c3-6430-4c41-8b39-b6b01ab91ee4 from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:14:16 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb7a12b-3c91-478b-b98b-f1846678aac0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:16 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD
Sep 23 00:14:16 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:16 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c is fetched for user 37232f44016d4f849a9f715ff8c31408. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=45,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=39,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036d03b-b632-4966-ad72-efadd0087df5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:16 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD
Sep 23 00:14:16 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:17 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1895290199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335ba6c3-6430-4c41-8b39-b6b01ab91ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955ae77e7a4940ee8ebf81b6f0d48558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:15Z,use_quota=True,user_id='37232f44016d4f849a9f715ff8c31408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Creating volume 335ba6c3-6430-4c41-8b39-b6b01ab91ee4 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:14:17 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:17 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 1073741824
Sep 23 00:14:17 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:17 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 1073741824" returned: 0 in 0.726s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:18 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4
Sep 23 00:14:18 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:18 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" returned: 0 in 0.312s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Attempting download of d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 335ba6c3-6430-4c41-8b39-b6b01ab91ee4. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffd8671-2df0-432c-af71-0f1f344f9b4d]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:18 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr
Sep 23 00:14:18 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:18 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr" returned: 0 in 0.448s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:19 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr
Sep 23 00:14:19 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:19 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr" returned: 1 in 0.440s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_db35hzvr' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc92bbf-47d2-4825-8f41-fa79f9f397b5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:19 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD
Sep 23 00:14:19 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:19 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] d3316061-b3c0-4b6e-8b31-c56fbf284d8c was qcow2, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:14:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:19 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4
Sep 23 00:14:19 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:22 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" returned: 0 in 2.601s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_k5mx_ai1devstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:14:22 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Converted 112.00 MB image at 43.04 MB/s
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:22 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 1G
Sep 23 00:14:22 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:22 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 1G" returned: 0 in 0.510s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Downloaded image d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 335ba6c3-6430-4c41-8b39-b6b01ab91ee4 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c for user 37232f44016d4f849a9f715ff8c31408 is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Marking volume 335ba6c3-6430-4c41-8b39-b6b01ab91ee4 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Copying metadata from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c to 335ba6c3-6430-4c41-8b39-b6b01ab91ee4. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:14:22 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Creating volume glance metadata for volume 335ba6c3-6430-4c41-8b39-b6b01ab91ee4 backed by image d3316061-b3c0-4b6e-8b31-c56fbf284d8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:14:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01dde6b-b4fd-4317-9b54-b7f563205eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf2281d0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e339dad-533f-48cf-b409-8d5824bd7998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:23 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Volume volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 (335ba6c3-6430-4c41-8b39-b6b01ab91ee4): created successfully
Sep 23 00:14:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e339dad-533f-48cf-b409-8d5824bd7998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Flow 'volume_create_manager' (acf4fd93-4a0a-4b29-9dbf-94113d6fbd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:23 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4512ef91-1249-4454-b83f-0b318a452f24 tempest-ServerActionsTestOtherA-1389854590 None] Created volume successfully.
Sep 23 00:14:33 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=8 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:33 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:INSERT=6,cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-00b445c3-b1cc-4b95-ab5f-cc53197d3861 req-d749828f-2334-4b11-992a-f8d94a4f6f8b tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-00b445c3-b1cc-4b95-ab5f-cc53197d3861 req-d749828f-2334-4b11-992a-f8d94a4f6f8b tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-00b445c3-b1cc-4b95-ab5f-cc53197d3861 req-d749828f-2334-4b11-992a-f8d94a4f6f8b tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-00b445c3-b1cc-4b95-ab5f-cc53197d3861 req-d749828f-2334-4b11-992a-f8d94a4f6f8b tempest-ServerActionsTestOtherA-1389854590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccdf31dd-278f-45c3-b63c-a36187a031a8', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:14:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-00b445c3-b1cc-4b95-ab5f-cc53197d3861 req-d749828f-2334-4b11-992a-f8d94a4f6f8b tempest-ServerActionsTestOtherA-1389854590 None] attachment_update completed successfully.
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:39 devstack sudo[91448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:14:39 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:40 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.490s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:14:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:14:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:14:43 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=7 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:15:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-e423f235-f2a2-4271-93fb-7b51f767e34c tempest-ServerActionsTestOtherA-1389854590 None] Terminate volume connection completed successfully.
Sep 23 00:15:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-e423f235-f2a2-4271-93fb-7b51f767e34c tempest-ServerActionsTestOtherA-1389854590 None] Deleting attachment ccdf31dd-278f-45c3-b63c-a36187a031a8. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:15:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-d2a86a94-c1c0-4b69-b21d-194e0be33766 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-d2a86a94-c1c0-4b69-b21d-194e0be33766 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-d2a86a94-c1c0-4b69-b21d-194e0be33766 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-d2a86a94-c1c0-4b69-b21d-194e0be33766 tempest-ServerActionsTestOtherA-1389854590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a6b4aca-1a8c-4ea4-8956-6663ed298d85', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:15:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-5a25af28-ed3c-4dfc-bcd4-8e1c12b42ce3 req-d2a86a94-c1c0-4b69-b21d-194e0be33766 tempest-ServerActionsTestOtherA-1389854590 None] attachment_update completed successfully.
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Flow 'volume_create_manager' (1e91f40d-1d92-4aa3-85ff-3417ea6403bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1116df0d-5822-4732-98d5-f2b363b525e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1116df0d-5822-4732-98d5-f2b363b525e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-898415522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87f09dd-e6c1-4df9-9016-82b332fb1ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677966cca8df413e9ad88a1ec88b1059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:28Z,use_quota=True,user_id='cbf871884aee48c7831d9c53c0d9a3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c012620-f4b9-4119-acdb-b476237fe47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c012620-f4b9-4119-acdb-b476237fe47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64671157-9a87-4b4b-9426-cfd4984560a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64671157-9a87-4b4b-9426-cfd4984560a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87f09dd-e6c1-4df9-9016-82b332fb1ff2', 'volume_name': 'volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa527951-f5e5-44b5-a541-7c1610d3f4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa527951-f5e5-44b5-a541-7c1610d3f4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb498691-2a81-4482-af40-17e3a0844fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:27 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Volume a87f09dd-e6c1-4df9-9016-82b332fb1ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2', 'volume_size': 1}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-898415522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87f09dd-e6c1-4df9-9016-82b332fb1ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677966cca8df413e9ad88a1ec88b1059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:28Z,use_quota=True,user_id='cbf871884aee48c7831d9c53c0d9a3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Creating volume a87f09dd-e6c1-4df9-9016-82b332fb1ff2 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:27 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:15:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:27 devstack sudo[92300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 1073741824
Sep 23 00:15:27 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:28 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 1073741824" returned: 0 in 0.783s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:28 devstack sudo[92310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2
Sep 23 00:15:28 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:29 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2" returned: 0 in 0.585s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb498691-2a81-4482-af40-17e3a0844fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89917b80-99f2-4750-8ae6-d83cd40ff0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:29 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Volume volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 (a87f09dd-e6c1-4df9-9016-82b332fb1ff2): created successfully
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89917b80-99f2-4750-8ae6-d83cd40ff0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Flow 'volume_create_manager' (1e91f40d-1d92-4aa3-85ff-3417ea6403bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4cf37352-ad55-4e5b-800b-de419c7830c2 tempest-AttachVolumeNegativeTest-36993877 None] Created volume successfully.
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Flow 'volume_create_manager' (d326c1de-0ef2-4e41-97e3-13fd57a1d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaec534b-af1c-4a32-856e-72699b6381e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaec534b-af1c-4a32-856e-72699b6381e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1769280200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dce5ee-8e50-4888-8c4f-fe0d92f03d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73691dd3ca84dc98081f03b55f82f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:30Z,use_quota=True,user_id='7b3b8c0b71cc4e55a0c66653244ea82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a3d6e0-d5e9-4d5b-bd6d-6d73709264b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a3d6e0-d5e9-4d5b-bd6d-6d73709264b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2570a210-7ea9-4c7e-9453-d9b7e9b4ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2570a210-7ea9-4c7e-9453-d9b7e9b4ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dce5ee-8e50-4888-8c4f-fe0d92f03d92', 'volume_name': 'volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61ab9ef-be3f-4c34-a640-3a806bc1c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61ab9ef-be3f-4c34-a640-3a806bc1c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd45b37-7442-4176-adcc-6990f200d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Volume 23dce5ee-8e50-4888-8c4f-fe0d92f03d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92', 'volume_size': 1}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1769280200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dce5ee-8e50-4888-8c4f-fe0d92f03d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73691dd3ca84dc98081f03b55f82f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:30Z,use_quota=True,user_id='7b3b8c0b71cc4e55a0c66653244ea82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Creating volume 23dce5ee-8e50-4888-8c4f-fe0d92f03d92 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:30 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:15:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:30 devstack sudo[92317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 1073741824
Sep 23 00:15:30 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:31 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 1073741824" returned: 0 in 0.849s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:31 devstack sudo[92333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92
Sep 23 00:15:31 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-2f4030ee-53fc-4d81-9449-b38d31ea6ee0 req-31699320-d205-41eb-84c5-8fbe226b8026 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:31 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-2f4030ee-53fc-4d81-9449-b38d31ea6ee0 req-31699320-d205-41eb-84c5-8fbe226b8026 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.260s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd45b37-7442-4176-adcc-6990f200d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a39919-a156-437b-b279-cc38d372efca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-2f4030ee-53fc-4d81-9449-b38d31ea6ee0 req-31699320-d205-41eb-84c5-8fbe226b8026 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Volume volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 (23dce5ee-8e50-4888-8c4f-fe0d92f03d92): created successfully
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a39919-a156-437b-b279-cc38d372efca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Flow 'volume_create_manager' (d326c1de-0ef2-4e41-97e3-13fd57a1d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b3c22766-2589-4c59-81bd-2041466bed0b tempest-AttachVolumeTestJSON-15973201 None] Created volume successfully.
Sep 23 00:15:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-2f4030ee-53fc-4d81-9449-b38d31ea6ee0 req-31699320-d205-41eb-84c5-8fbe226b8026 tempest-AttachVolumeNegativeTest-36993877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33eae1b2-4869-4306-b522-7ecc1d5d5702', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:15:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-2f4030ee-53fc-4d81-9449-b38d31ea6ee0 req-31699320-d205-41eb-84c5-8fbe226b8026 tempest-AttachVolumeNegativeTest-36993877 None] attachment_update completed successfully.
Sep 23 00:15:33 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Flow 'volume_create_manager' (05105fbd-92b9-43b0-87e1-a3d3d0326a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71f99f5-f94c-47c9-8439-8f405bf911a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71f99f5-f94c-47c9-8439-8f405bf911a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-357021988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6d7eaf-2109-4b57-87a5-58df030c240a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4743156a5a742348cbb9e9fc4c47495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:34Z,use_quota=True,user_id='a7628885ee774874ab844d25213b3eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7628dfd-9902-4629-bcda-8ec5651a97cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7628dfd-9902-4629-bcda-8ec5651a97cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7cc03c-1cf3-4350-989e-0df21db9eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7cc03c-1cf3-4350-989e-0df21db9eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6d7eaf-2109-4b57-87a5-58df030c240a', 'volume_name': 'volume-7c6d7eaf-2109-4b57-87a5-58df030c240a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1113d9d-90a2-4ed9-80cb-b26a39ca3597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1113d9d-90a2-4ed9-80cb-b26a39ca3597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e60fcc7-cbca-4600-a919-b272b1498781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:34 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Volume 7c6d7eaf-2109-4b57-87a5-58df030c240a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6d7eaf-2109-4b57-87a5-58df030c240a', 'volume_size': 1}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-357021988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6d7eaf-2109-4b57-87a5-58df030c240a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4743156a5a742348cbb9e9fc4c47495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:34Z,use_quota=True,user_id='a7628885ee774874ab844d25213b3eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Creating volume 7c6d7eaf-2109-4b57-87a5-58df030c240a {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:34 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:34 devstack sudo[92377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a 1073741824
Sep 23 00:15:34 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0a54f77f-f4ce-443e-97c0-b9d83dab0fff req-d8dd6a93-ff82-47c4-af32-bbea020ab475 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:34 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a 1073741824" returned: 0 in 0.720s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:34 devstack sudo[92384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a
Sep 23 00:15:34 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:35 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a" returned: 0 in 0.320s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0a54f77f-f4ce-443e-97c0-b9d83dab0fff req-d8dd6a93-ff82-47c4-af32-bbea020ab475 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e60fcc7-cbca-4600-a919-b272b1498781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6d7eaf-2109-4b57-87a5-58df030c240a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36896f9e-e20d-4f65-b597-c2d39cae0d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0a54f77f-f4ce-443e-97c0-b9d83dab0fff req-d8dd6a93-ff82-47c4-af32-bbea020ab475 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Volume volume-7c6d7eaf-2109-4b57-87a5-58df030c240a (7c6d7eaf-2109-4b57-87a5-58df030c240a): created successfully
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36896f9e-e20d-4f65-b597-c2d39cae0d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Flow 'volume_create_manager' (05105fbd-92b9-43b0-87e1-a3d3d0326a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2ca2ee54-e969-4daa-b084-a55e029544d9 tempest-TaggedAttachmentsTest-329007372 None] Created volume successfully.
Sep 23 00:15:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-0a54f77f-f4ce-443e-97c0-b9d83dab0fff req-d8dd6a93-ff82-47c4-af32-bbea020ab475 tempest-AttachVolumeTestJSON-15973201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12761067-1bf1-40c5-a6b1-e46c00a99577', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:15:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-0a54f77f-f4ce-443e-97c0-b9d83dab0fff req-d8dd6a93-ff82-47c4-af32-bbea020ab475 tempest-AttachVolumeTestJSON-15973201 None] attachment_update completed successfully.
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Flow 'volume_create_manager' (445df482-0921-42d7-8184-6188cfaa1912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae539ba-4097-49c6-b134-9ffbd73e23e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae539ba-4097-49c6-b134-9ffbd73e23e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-152595260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f20fdac-f602-4428-b09f-6bb870ddcb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73691dd3ca84dc98081f03b55f82f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:38Z,use_quota=True,user_id='7b3b8c0b71cc4e55a0c66653244ea82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff51251-9e74-4e6a-adf3-ddddccaf44ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff51251-9e74-4e6a-adf3-ddddccaf44ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3662ece-6138-46ec-bf03-bb2bf95217d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3662ece-6138-46ec-bf03-bb2bf95217d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f20fdac-f602-4428-b09f-6bb870ddcb40', 'volume_name': 'volume-5f20fdac-f602-4428-b09f-6bb870ddcb40', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98faec19-5754-4b18-bfcd-edb1c624ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98faec19-5754-4b18-bfcd-edb1c624ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd4e4aa-da61-4ee2-bb66-9ad294538575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Volume 5f20fdac-f602-4428-b09f-6bb870ddcb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f20fdac-f602-4428-b09f-6bb870ddcb40', 'volume_size': 1}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-152595260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f20fdac-f602-4428-b09f-6bb870ddcb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73691dd3ca84dc98081f03b55f82f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:38Z,use_quota=True,user_id='7b3b8c0b71cc4e55a0c66653244ea82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Creating volume 5f20fdac-f602-4428-b09f-6bb870ddcb40 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:38 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:15:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:38 devstack sudo[92415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 1073741824
Sep 23 00:15:38 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:39 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 1073741824" returned: 0 in 0.816s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:39 devstack sudo[92424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40
Sep 23 00:15:39 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:39 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40" returned: 0 in 0.425s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd4e4aa-da61-4ee2-bb66-9ad294538575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f20fdac-f602-4428-b09f-6bb870ddcb40', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae2b5a9-e518-470c-8eca-3297d8caf1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Volume volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 (5f20fdac-f602-4428-b09f-6bb870ddcb40): created successfully
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae2b5a9-e518-470c-8eca-3297d8caf1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Flow 'volume_create_manager' (445df482-0921-42d7-8184-6188cfaa1912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-37b00a44-118a-4c12-8085-5dd2d40af8f4 tempest-AttachVolumeTestJSON-15973201 None] Created volume successfully.
Sep 23 00:15:39 devstack sudo[92427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:15:39 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:40 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.536s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:15:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:15:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:15:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:15:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-c455e6e2-135f-4319-b2db-413cda232a2a req-aa5f3f74-0287-40d5-9870-afaf03b488d5 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-c455e6e2-135f-4319-b2db-413cda232a2a req-aa5f3f74-0287-40d5-9870-afaf03b488d5 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-c455e6e2-135f-4319-b2db-413cda232a2a req-aa5f3f74-0287-40d5-9870-afaf03b488d5 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-c455e6e2-135f-4319-b2db-413cda232a2a req-aa5f3f74-0287-40d5-9870-afaf03b488d5 tempest-AttachVolumeTestJSON-15973201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-5f20fdac-f602-4428-b09f-6bb870ddcb40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1634f485-6c6c-469f-8f60-582f05d1f252', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:15:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-c455e6e2-135f-4319-b2db-413cda232a2a req-aa5f3f74-0287-40d5-9870-afaf03b488d5 tempest-AttachVolumeTestJSON-15973201 None] attachment_update completed successfully.
Sep 23 00:15:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-ea3ef0bd-04dc-4df9-a598-358e109faa7a req-ddc93f83-5d07-44e3-b16b-7f0beb0a0353 tempest-AttachVolumeTestJSON-15973201 None] Terminate volume connection completed successfully.
Sep 23 00:15:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-ea3ef0bd-04dc-4df9-a598-358e109faa7a req-ddc93f83-5d07-44e3-b16b-7f0beb0a0353 tempest-AttachVolumeTestJSON-15973201 None] Deleting attachment 12761067-1bf1-40c5-a6b1-e46c00a99577. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:15:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-c4ebff38-2c18-4a4b-b09e-71c13692a98c req-5ca75e95-b2c0-43b3-826e-d2238106c976 tempest-AttachVolumeTestJSON-15973201 None] Terminate volume connection completed successfully.
Sep 23 00:15:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-c4ebff38-2c18-4a4b-b09e-71c13692a98c req-5ca75e95-b2c0-43b3-826e-d2238106c976 tempest-AttachVolumeTestJSON-15973201 None] Deleting attachment 1634f485-6c6c-469f-8f60-582f05d1f252. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:15:59 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=19,cinder:SELECT=31,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:15:59 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=28,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-94ccdeb9-26a1-468e-8206-919777f72a83 tempest-ServerActionsTestOtherA-1389854590 None] Terminate volume connection completed successfully.
Sep 23 00:16:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-94ccdeb9-26a1-468e-8206-919777f72a83 tempest-ServerActionsTestOtherA-1389854590 None] Deleting attachment 6a6b4aca-1a8c-4ea4-8956-6663ed298d85. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:16:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "cinder-335ba6c3-6430-4c41-8b39-b6b01ab91ee4-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-335ba6c3-6430-4c41-8b39-b6b01ab91ee4-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "cinder-quobyte-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-quobyte-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" acquired by "delete_volume" :: waited 0.043s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:04 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f3610-5bf8-4224-a63b-ce148d01a725]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:04 devstack sudo[92691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4
Sep 23 00:16:04 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:05 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" returned: 0 in 1.021s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:05 devstack sudo[92697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4
Sep 23 00:16:05 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:06 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" returned: 0 in 0.629s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-quobyte-335ba6c3-6430-4c41-8b39-b6b01ab91ee4" released by "delete_volume" :: held 1.833s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.quota [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Created reservations ['cab1e430-c830-423c-9252-450c68a7537e', '91621da5-2c13-4536-b9dc-de6e51c292c2', '8c8304df-43dc-408a-b30f-5ea5132e2ae5', '759ecc1a-0e4d-4bff-b4c6-819271290b03', 'd5fa3f91-36c2-4f71-b6da-b1eb7c495792'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "cinder-5f20fdac-f602-4428-b09f-6bb870ddcb40-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-5f20fdac-f602-4428-b09f-6bb870ddcb40-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "cinder-quobyte-5f20fdac-f602-4428-b09f-6bb870ddcb40" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-quobyte-5f20fdac-f602-4428-b09f-6bb870ddcb40" acquired by "delete_volume" :: waited 0.173s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:06 devstack sudo[92735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:06 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc7de9-d9e1-4f9f-9611-3d30a6532323]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "cinder-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:07 devstack sudo[92737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40
Sep 23 00:16:07 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "cinder-quobyte-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-quobyte-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d84959-0b83-441b-9a72-92331fdaaa20]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack sudo[92739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36
Sep 23 00:16:07 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:07 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.725s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG cinder.manager [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:07 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Deleted volume successfully.
Sep 23 00:16:07 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40" returned: 0 in 0.639s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-6318d05b-2c8c-4cc2-a77d-4bec5d2ddfea req-db32d53e-c0de-44f5-b87e-494ddeefa29a tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-335ba6c3-6430-4c41-8b39-b6b01ab91ee4-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:07 devstack sudo[92745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40
Sep 23 00:16:07 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:07 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36" returned: 0 in 0.637s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5f20fdac-f602-4428-b09f-6bb870ddcb40" returned: 0 in 0.423s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack sudo[92751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36
Sep 23 00:16:07 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-quobyte-5f20fdac-f602-4428-b09f-6bb870ddcb40" released by "delete_volume" :: held 1.197s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Created reservations ['c539d0e7-f516-4681-a9dc-4e7911aef016', 'ae744e79-e229-4e9c-b259-ee13c19c4f80', 'a83e61d5-54d5-45b1-a152-96c92fbbfff8', 'bc2e5f3d-5481-4605-b70c-f7e576a41cba', '432b1614-7313-449e-b9e8-307ab52e057d'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:08 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36" returned: 0 in 0.517s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:08 devstack sudo[92788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:08 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-quobyte-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36" released by "delete_volume" :: held 1.234s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Created reservations ['7957b4e4-01d6-4748-87cd-d7539f437615', '0cb53327-d3ba-4183-aba8-fc94912ec7eb', 'bff95db9-b962-4660-a4a1-996cf02a1d15', 'd72251ad-acde-4e30-8768-c3e7d97cda5d', 'eb6e9ff7-8ad5-41df-9fe8-d43d27bc6421'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:08 devstack sudo[92792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:08 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:08 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.564s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:08 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Deleted volume successfully.
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23ad4341-06f0-42bb-86e2-eb1857c2d767 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-5f20fdac-f602-4428-b09f-6bb870ddcb40-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:09 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.421s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Deleted volume successfully.
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-335dcd28-452b-43e0-9ef5-96723c24d038 tempest-ServerActionsTestOtherA-1389854590 None] Lock "cinder-6a37dbca-0b23-4cd4-9ee6-9eaffb687f36-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "cinder-23dce5ee-8e50-4888-8c4f-fe0d92f03d92-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-23dce5ee-8e50-4888-8c4f-fe0d92f03d92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "cinder-quobyte-23dce5ee-8e50-4888-8c4f-fe0d92f03d92" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-quobyte-23dce5ee-8e50-4888-8c4f-fe0d92f03d92" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8a6064-99c6-4d57-acdb-d7e8973d9ae7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:09 devstack sudo[92796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92
Sep 23 00:16:09 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:10 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92" returned: 0 in 0.656s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:10 devstack sudo[92815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92
Sep 23 00:16:10 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:10 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-23dce5ee-8e50-4888-8c4f-fe0d92f03d92" returned: 0 in 0.581s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-quobyte-23dce5ee-8e50-4888-8c4f-fe0d92f03d92" released by "delete_volume" :: held 1.330s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:10 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Created reservations ['ada71a3c-c0e0-40cd-a679-1f98835fefd1', '9d493e9b-792d-4576-a4ae-987bb476155f', '89513b88-8f8e-4022-b96b-8f5b8f0a0b62', '5ba5f220-0ceb-4e17-820b-a59923f0162f', '6aa00a41-f633-43c6-b69e-79a667947c84'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:11 devstack sudo[92852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:11 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:11 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.378s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Deleted volume successfully.
Sep 23 00:16:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4e8d2faf-51f5-4a7a-a7f8-2e708326973a tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-23dce5ee-8e50-4888-8c4f-fe0d92f03d92-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "cinder-169af4b5-0401-4b03-9bfb-8817c0839148-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-169af4b5-0401-4b03-9bfb-8817c0839148-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "cinder-quobyte-169af4b5-0401-4b03-9bfb-8817c0839148" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-quobyte-169af4b5-0401-4b03-9bfb-8817c0839148" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1a76ae-d730-4d3e-ac20-ef4440d542d3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:12 devstack sudo[92863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148
Sep 23 00:16:12 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:12 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148" returned: 0 in 0.500s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:12 devstack sudo[92868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148
Sep 23 00:16:12 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:13 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-169af4b5-0401-4b03-9bfb-8817c0839148" returned: 0 in 0.353s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-quobyte-169af4b5-0401-4b03-9bfb-8817c0839148" released by "delete_volume" :: held 0.928s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Created reservations ['82ad59c4-5dfd-4d10-87e8-9d6bc227b614', '5eb68a0c-3085-4aad-b641-b7eb9268faac', '12f276a6-c11d-45ef-8be0-10f9bc6ff936', 'e5aae046-e65b-4173-86a5-fa72480a784a', '2e6688e2-91dd-4bfb-a0a9-06fd83bcbc70'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:13 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:13 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:13 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.321s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Deleted volume successfully.
Sep 23 00:16:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab508947-02f6-4c11-929b-23155407f240 tempest-AttachVolumeTestJSON-15973201 None] Lock "cinder-169af4b5-0401-4b03-9bfb-8817c0839148-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:23 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=35,cinder:INSERT=12,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:23 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=47,cinder:SELECT=27,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-049f702b-af86-4406-b826-d02186d79cce req-e507ad8f-5635-4865-a2f8-a5509a5d863a tempest-AttachVolumeNegativeTest-36993877 None] Terminate volume connection completed successfully.
Sep 23 00:16:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-049f702b-af86-4406-b826-d02186d79cce req-e507ad8f-5635-4865-a2f8-a5509a5d863a tempest-AttachVolumeNegativeTest-36993877 None] Deleting attachment 33eae1b2-4869-4306-b522-7ecc1d5d5702. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Flow 'volume_create_manager' (7f4b92a9-921f-42ed-919e-cd7c2e2cb739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff566b2-e28b-46c7-8494-3ff970a75cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff566b2-e28b-46c7-8494-3ff970a75cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1476169088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf677fa-90c9-4d27-b687-1a32e6d32258,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805bb3250eff4b61aa6ef48e627fc72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:30Z,use_quota=True,user_id='68121908a25146d08a309b48e60e9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cd029-86aa-476b-ab4e-3d7e67af85fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cd029-86aa-476b-ab4e-3d7e67af85fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb2830b-5564-4ebf-ab6a-389839451a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb2830b-5564-4ebf-ab6a-389839451a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf677fa-90c9-4d27-b687-1a32e6d32258', 'volume_name': 'volume-faf677fa-90c9-4d27-b687-1a32e6d32258', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc84d1f-1529-40ec-9573-6456068617dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc84d1f-1529-40ec-9573-6456068617dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1965e83-b6de-497e-a71f-6842df1c2748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:29 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Volume faf677fa-90c9-4d27-b687-1a32e6d32258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf677fa-90c9-4d27-b687-1a32e6d32258', 'volume_size': 1}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1476169088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf677fa-90c9-4d27-b687-1a32e6d32258,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805bb3250eff4b61aa6ef48e627fc72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:30Z,use_quota=True,user_id='68121908a25146d08a309b48e60e9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Creating volume faf677fa-90c9-4d27-b687-1a32e6d32258 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:29 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:16:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:29 devstack sudo[92939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258 1073741824
Sep 23 00:16:29 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:30 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258 1073741824" returned: 0 in 0.798s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:30 devstack sudo[92948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258
Sep 23 00:16:30 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:31 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1965e83-b6de-497e-a71f-6842df1c2748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf677fa-90c9-4d27-b687-1a32e6d32258', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67102147-81ae-4277-af38-806742533063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Volume volume-faf677fa-90c9-4d27-b687-1a32e6d32258 (faf677fa-90c9-4d27-b687-1a32e6d32258): created successfully
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67102147-81ae-4277-af38-806742533063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Flow 'volume_create_manager' (7f4b92a9-921f-42ed-919e-cd7c2e2cb739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-8a19043f-5d8b-4019-bf72-77b5f9bec9bf req-a10af006-fa9e-45db-8246-e28b0b8ea49b tempest-VolumesGetTestJSON-1491942161 None] Created volume successfully.
Sep 23 00:16:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Acquiring lock "cinder-faf677fa-90c9-4d27-b687-1a32e6d32258-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Lock "cinder-faf677fa-90c9-4d27-b687-1a32e6d32258-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Acquiring lock "cinder-quobyte-faf677fa-90c9-4d27-b687-1a32e6d32258" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Lock "cinder-quobyte-faf677fa-90c9-4d27-b687-1a32e6d32258" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[027eeae6-9a72-44a2-ae1e-f19841e1adaf]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:33 devstack sudo[93004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258
Sep 23 00:16:33 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:33 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258" returned: 0 in 0.667s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:33 devstack sudo[93013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258
Sep 23 00:16:33 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:33 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faf677fa-90c9-4d27-b687-1a32e6d32258" returned: 0 in 0.394s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Lock "cinder-quobyte-faf677fa-90c9-4d27-b687-1a32e6d32258" released by "delete_volume" :: held 1.154s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG cinder.quota [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Created reservations ['df75b657-c96f-42d3-88cf-2dad72f8a9a5', '5d0bd02b-41ae-4329-96d3-8c1624eef749', '4e6263c6-b2d2-4796-bc69-ea92c92b7086', 'ff6ff8bb-8976-4a9d-a498-aaa850774d1c', '7a2b0ceb-e8c0-4a8f-8524-50aa95b92b13'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:34 devstack sudo[93021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:34 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-54bb90b4-97d7-4a06-8783-78a76cca0269 req-96bc802d-c774-477e-8275-a289e27f06fd tempest-TaggedAttachmentsTest-329007372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-54bb90b4-97d7-4a06-8783-78a76cca0269 req-96bc802d-c774-477e-8275-a289e27f06fd tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-54bb90b4-97d7-4a06-8783-78a76cca0269 req-96bc802d-c774-477e-8275-a289e27f06fd tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:34 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.438s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG cinder.manager [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Deleted volume successfully.
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-54bb90b4-97d7-4a06-8783-78a76cca0269 req-96bc802d-c774-477e-8275-a289e27f06fd tempest-TaggedAttachmentsTest-329007372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-7c6d7eaf-2109-4b57-87a5-58df030c240a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfb4be85-0c8c-4173-8511-2d6cee13eac2', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:16:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-869de334-a9a3-40cf-8fe5-a21fff0f3c52 req-68d329ce-dea1-468c-b3de-63eddaf78a1b tempest-VolumesGetTestJSON-1491942161 None] Lock "cinder-faf677fa-90c9-4d27-b687-1a32e6d32258-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-54bb90b4-97d7-4a06-8783-78a76cca0269 req-96bc802d-c774-477e-8275-a289e27f06fd tempest-TaggedAttachmentsTest-329007372 None] attachment_update completed successfully.
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:39 devstack sudo[93448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:39 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:40 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.376s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:16:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:16:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:16:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-6595648a-a147-4743-bb3a-e76797c472c0 req-5ec113df-45a4-49fa-b443-bb0d327f44bd tempest-TaggedAttachmentsTest-329007372 None] Terminate volume connection completed successfully.
Sep 23 00:16:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-6595648a-a147-4743-bb3a-e76797c472c0 req-5ec113df-45a4-49fa-b443-bb0d327f44bd tempest-TaggedAttachmentsTest-329007372 None] Deleting attachment dfb4be85-0c8c-4173-8511-2d6cee13eac2. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Flow 'volume_create_manager' (da31ba86-269f-44c1-820e-5b879a46057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6528640a-9c92-4970-903a-5e3dab7a6b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6528640a-9c92-4970-903a-5e3dab7a6b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-426189923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0473e26-7345-464b-a502-0259d9867f0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca88260f30714cbdb124151597912488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:43Z,use_quota=True,user_id='8582277c9ea34ded94feb438cf696ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022915df-b313-4504-a39d-810a59ac3cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022915df-b313-4504-a39d-810a59ac3cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fef123-3418-425e-a77b-b66e398cb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fef123-3418-425e-a77b-b66e398cb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0473e26-7345-464b-a502-0259d9867f0f', 'volume_name': 'volume-a0473e26-7345-464b-a502-0259d9867f0f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8157d4-50bb-4f97-afcf-08222990bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8157d4-50bb-4f97-afcf-08222990bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8b8273-eb9e-4b2e-a320-714abff23a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Volume a0473e26-7345-464b-a502-0259d9867f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0473e26-7345-464b-a502-0259d9867f0f', 'volume_size': 1}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-426189923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0473e26-7345-464b-a502-0259d9867f0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca88260f30714cbdb124151597912488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:43Z,use_quota=True,user_id='8582277c9ea34ded94feb438cf696ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Creating volume a0473e26-7345-464b-a502-0259d9867f0f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:43 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:16:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:43 devstack sudo[93481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f 1073741824
Sep 23 00:16:43 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:44 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f 1073741824" returned: 0 in 1.051s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:44 devstack sudo[93507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f
Sep 23 00:16:44 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:44 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f" returned: 0 in 0.506s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8b8273-eb9e-4b2e-a320-714abff23a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0473e26-7345-464b-a502-0259d9867f0f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d707c876-2760-491c-926d-9c2788aa75c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:45 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Volume volume-a0473e26-7345-464b-a502-0259d9867f0f (a0473e26-7345-464b-a502-0259d9867f0f): created successfully
Sep 23 00:16:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d707c876-2760-491c-926d-9c2788aa75c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Flow 'volume_create_manager' (da31ba86-269f-44c1-820e-5b879a46057b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e83c7a7b-ac9d-40f8-bba5-7a06ae9e5144 tempest-VolumesTestJSON-948786526 None] Created volume successfully.
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Flow 'volume_create_manager' (f81e75b9-0700-47f3-b9ec-6a4bda3addb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdff69c-7b0d-41b9-942d-47fdba575168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdff69c-7b0d-41b9-942d-47fdba575168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2110594583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be162c29-7f41-4ad1-a07c-84febe7184eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca88260f30714cbdb124151597912488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:46Z,use_quota=True,user_id='8582277c9ea34ded94feb438cf696ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1d491c-1fe7-4347-bcdf-00edc3a7e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1d491c-1fe7-4347-bcdf-00edc3a7e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c13837-82f1-465e-9477-30b61f596c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c13837-82f1-465e-9477-30b61f596c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be162c29-7f41-4ad1-a07c-84febe7184eb', 'volume_name': 'volume-be162c29-7f41-4ad1-a07c-84febe7184eb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f1b327-a27f-438f-ac4a-bdadf3fa813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f1b327-a27f-438f-ac4a-bdadf3fa813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d397d97-a88a-46a3-b833-830097fa2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:46 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Volume be162c29-7f41-4ad1-a07c-84febe7184eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be162c29-7f41-4ad1-a07c-84febe7184eb', 'volume_size': 1}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2110594583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be162c29-7f41-4ad1-a07c-84febe7184eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca88260f30714cbdb124151597912488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:46Z,use_quota=True,user_id='8582277c9ea34ded94feb438cf696ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Creating volume be162c29-7f41-4ad1-a07c-84febe7184eb {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:46 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:16:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:46 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb 1073741824
Sep 23 00:16:46 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:47 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb 1073741824" returned: 0 in 0.887s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:47 devstack sudo[93534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb
Sep 23 00:16:47 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:48 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb" returned: 0 in 0.452s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d397d97-a88a-46a3-b833-830097fa2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be162c29-7f41-4ad1-a07c-84febe7184eb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1303501-2325-4fc7-80a3-ef4113779d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:48 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Volume volume-be162c29-7f41-4ad1-a07c-84febe7184eb (be162c29-7f41-4ad1-a07c-84febe7184eb): created successfully
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1303501-2325-4fc7-80a3-ef4113779d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Flow 'volume_create_manager' (f81e75b9-0700-47f3-b9ec-6a4bda3addb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c23e98ad-59f3-4f48-b4aa-ac778f68686b tempest-VolumesTestJSON-948786526 None] Created volume successfully.
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Flow 'volume_create_manager' (009b3418-f8a8-4556-a9b2-48792a63272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754e1089-a715-4490-86d1-e26c210f8691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754e1089-a715-4490-86d1-e26c210f8691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1086149965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f596b50-b8df-4231-bf42-2d428a1bba82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca88260f30714cbdb124151597912488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:50Z,use_quota=True,user_id='8582277c9ea34ded94feb438cf696ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5568a-9506-4556-bd85-a9ccc350e033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5568a-9506-4556-bd85-a9ccc350e033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add4f293-15c0-4f0d-91f3-dabd83105b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add4f293-15c0-4f0d-91f3-dabd83105b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f596b50-b8df-4231-bf42-2d428a1bba82', 'volume_name': 'volume-0f596b50-b8df-4231-bf42-2d428a1bba82', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ef23cc-9e0a-4ede-8714-f3e22f1637fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ef23cc-9e0a-4ede-8714-f3e22f1637fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfa7d5c-b4a1-47dc-9e39-476415dfedab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:50 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Volume 0f596b50-b8df-4231-bf42-2d428a1bba82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f596b50-b8df-4231-bf42-2d428a1bba82', 'volume_size': 1}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1086149965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f596b50-b8df-4231-bf42-2d428a1bba82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca88260f30714cbdb124151597912488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:50Z,use_quota=True,user_id='8582277c9ea34ded94feb438cf696ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Creating volume 0f596b50-b8df-4231-bf42-2d428a1bba82 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:50 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:16:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:50 devstack sudo[93582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82 1073741824
Sep 23 00:16:50 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:51 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82 1073741824" returned: 0 in 0.781s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:51 devstack sudo[93596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82
Sep 23 00:16:51 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:51 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82" returned: 0 in 0.318s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfa7d5c-b4a1-47dc-9e39-476415dfedab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f596b50-b8df-4231-bf42-2d428a1bba82', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5b7d65-875c-4275-b775-ab3128390965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:51 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Volume volume-0f596b50-b8df-4231-bf42-2d428a1bba82 (0f596b50-b8df-4231-bf42-2d428a1bba82): created successfully
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5b7d65-875c-4275-b775-ab3128390965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Flow 'volume_create_manager' (009b3418-f8a8-4556-a9b2-48792a63272e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0999cec8-901f-4e6e-89dd-e4d6b993c054 tempest-VolumesTestJSON-948786526 None] Created volume successfully.
Sep 23 00:16:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Acquiring lock "cinder-0f596b50-b8df-4231-bf42-2d428a1bba82-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Lock "cinder-0f596b50-b8df-4231-bf42-2d428a1bba82-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Acquiring lock "cinder-quobyte-0f596b50-b8df-4231-bf42-2d428a1bba82" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Lock "cinder-quobyte-0f596b50-b8df-4231-bf42-2d428a1bba82" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198f230-d46b-437e-894d-95eaf18b591d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:54 devstack sudo[93621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82
Sep 23 00:16:54 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:55 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82" returned: 0 in 1.028s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:55 devstack sudo[93673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82
Sep 23 00:16:55 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:55 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0f596b50-b8df-4231-bf42-2d428a1bba82" returned: 0 in 0.637s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Lock "cinder-quobyte-0f596b50-b8df-4231-bf42-2d428a1bba82" released by "delete_volume" :: held 1.802s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Created reservations ['dfee8287-1ae1-43f7-886d-f4e9f2722700', 'fb0da1ab-099d-4508-8dca-4f9d551c97b7', '97e60953-d4f6-4821-bcec-b18b9cffd38f', 'baff5164-2871-42e5-a772-5a4a3687546d', '6074663c-938f-4c21-adc3-36d3d3b4cd5e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Acquiring lock "cinder-be162c29-7f41-4ad1-a07c-84febe7184eb-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:56 devstack sudo[93727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:56 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Lock "cinder-be162c29-7f41-4ad1-a07c-84febe7184eb-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Acquiring lock "cinder-quobyte-be162c29-7f41-4ad1-a07c-84febe7184eb" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Lock "cinder-quobyte-be162c29-7f41-4ad1-a07c-84febe7184eb" acquired by "delete_volume" :: waited 0.077s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:57 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[542bbe8a-dd55-4657-a65e-23b35dc012f9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:57 devstack sudo[93739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb
Sep 23 00:16:57 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:57 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 1.033s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:57 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Deleted volume successfully.
Sep 23 00:16:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3662bc6f-4546-4e63-b85a-961e16776f60 tempest-VolumesTestJSON-948786526 None] Lock "cinder-0f596b50-b8df-4231-bf42-2d428a1bba82-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:58 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb" returned: 0 in 1.358s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:58 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb
Sep 23 00:16:58 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:59 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-be162c29-7f41-4ad1-a07c-84febe7184eb" returned: 0 in 0.806s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Lock "cinder-quobyte-be162c29-7f41-4ad1-a07c-84febe7184eb" released by "delete_volume" :: held 2.351s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Created reservations ['d11153e6-f22f-4dd6-afa3-115a67abd6b0', '721c3fb8-d973-4fee-8aff-05d278762ba1', 'bfa85110-6143-40ff-b37b-d34e3c8b6ecf', 'a74a60af-ae24-4a57-9624-d952150d3327', '9a2230ea-80d6-401d-a8be-6cdd1fd2d63a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:59 devstack sudo[93774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:16:59 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:00 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.788s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Acquiring lock "cinder-a0473e26-7345-464b-a502-0259d9867f0f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Deleted volume successfully.
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Lock "cinder-a0473e26-7345-464b-a502-0259d9867f0f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8b06ab39-16d2-4edd-a184-78915c5b3bd5 tempest-VolumesTestJSON-948786526 None] Lock "cinder-be162c29-7f41-4ad1-a07c-84febe7184eb-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Acquiring lock "cinder-quobyte-a0473e26-7345-464b-a502-0259d9867f0f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Lock "cinder-quobyte-a0473e26-7345-464b-a502-0259d9867f0f" acquired by "delete_volume" :: waited 0.058s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57c06d-15f4-4594-84e1-86539501dca2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:01 devstack sudo[93778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f
Sep 23 00:17:01 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:01 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f" returned: 0 in 1.031s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:01 devstack sudo[93786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f
Sep 23 00:17:01 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:02 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0473e26-7345-464b-a502-0259d9867f0f" returned: 0 in 0.758s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Lock "cinder-quobyte-a0473e26-7345-464b-a502-0259d9867f0f" released by "delete_volume" :: held 1.918s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:02 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Created reservations ['fb637068-293f-41f3-8553-c1d96a16c7a4', '51179294-dad5-4a9a-9b17-4225c76a2d70', '0af45217-38a9-41eb-85f9-3b840f494574', '9ed3cad1-4123-4f66-b0fe-c3a433128c32', '7e483967-eb1c-48ff-9845-34b8751b26c3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:17:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:03 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:17:03 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:04 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.938s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:04 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Deleted volume successfully.
Sep 23 00:17:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3fa8a16e-cedc-4054-85e7-e053b8f16b35 tempest-VolumesTestJSON-948786526 None] Lock "cinder-a0473e26-7345-464b-a502-0259d9867f0f-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Acquiring lock "cinder-7c6d7eaf-2109-4b57-87a5-58df030c240a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Lock "cinder-7c6d7eaf-2109-4b57-87a5-58df030c240a-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Acquiring lock "cinder-quobyte-7c6d7eaf-2109-4b57-87a5-58df030c240a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Lock "cinder-quobyte-7c6d7eaf-2109-4b57-87a5-58df030c240a" acquired by "delete_volume" :: waited 0.078s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ce9fbc-c680-48fb-bc9a-9a04218ea990]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:07 devstack sudo[93838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a
Sep 23 00:17:07 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:08 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a" returned: 0 in 1.429s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:08 devstack sudo[93844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a
Sep 23 00:17:08 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:09 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7c6d7eaf-2109-4b57-87a5-58df030c240a" returned: 0 in 1.069s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Lock "cinder-quobyte-7c6d7eaf-2109-4b57-87a5-58df030c240a" released by "delete_volume" :: held 2.677s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Created reservations ['41982f95-d3fb-4b3e-af7e-33636adeb65f', '1ef540e1-3151-430c-8778-7579d459d1b2', '4a718076-b94f-470a-b041-1c19959d155c', 'eb1eb383-0ec0-4e2c-b486-d874b7b78b8c', '969cb18a-6713-4640-b374-ecd3ca7e394a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:10 devstack sudo[93881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:17:10 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:10 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:10 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Deleted volume successfully.
Sep 23 00:17:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0f4c8a08-9cb8-4337-b9ba-80387451d01e tempest-TaggedAttachmentsTest-329007372 None] Lock "cinder-7c6d7eaf-2109-4b57-87a5-58df030c240a-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:20 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=45,cinder:UPDATE=63,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:17:20 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=49,cinder:INSERT=17,cinder:UPDATE=55,cinder:DELETE=4 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Flow 'volume_create_manager' (f9b88505-8933-495c-a145-a80d39909504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9409e5c9-d25a-4a25-b507-8aefb19b6a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9409e5c9-d25a-4a25-b507-8aefb19b6a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-462381324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e75b94-5e4e-4007-9977-fbc1033d5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58664fe3ef024ddca2547350a0a830a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:22Z,use_quota=True,user_id='2a60c22365474a7ba8c34757065301c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9051a936-715b-437e-b091-1e8027e3c91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9051a936-715b-437e-b091-1e8027e3c91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f02ab85-b069-44a3-be0f-3d287390077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f02ab85-b069-44a3-be0f-3d287390077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e75b94-5e4e-4007-9977-fbc1033d5b86', 'volume_name': 'volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321f05e9-46e2-44d2-be3d-3162840364a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321f05e9-46e2-44d2-be3d-3162840364a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499be975-2d6c-4562-9d30-310816652bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:22 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Volume a7e75b94-5e4e-4007-9977-fbc1033d5b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86', 'volume_size': 1}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-462381324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e75b94-5e4e-4007-9977-fbc1033d5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58664fe3ef024ddca2547350a0a830a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:22Z,use_quota=True,user_id='2a60c22365474a7ba8c34757065301c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Creating volume a7e75b94-5e4e-4007-9977-fbc1033d5b86 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:22 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:17:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:22 devstack sudo[94024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 1073741824
Sep 23 00:17:22 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:23 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 1073741824" returned: 0 in 0.969s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:23 devstack sudo[94029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86
Sep 23 00:17:23 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:24 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86" returned: 0 in 0.593s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499be975-2d6c-4562-9d30-310816652bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db41c0b-bac0-4e93-9cf9-97ad11e93f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:24 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Volume volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 (a7e75b94-5e4e-4007-9977-fbc1033d5b86): created successfully
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db41c0b-bac0-4e93-9cf9-97ad11e93f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Flow 'volume_create_manager' (f9b88505-8933-495c-a145-a80d39909504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:24 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-406f8b61-7105-4725-a10c-4553664825a5 tempest-ServerRescueNegativeTestJSON-247532858 None] Created volume successfully.
Sep 23 00:17:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a74544d1-a5e5-494c-9a7e-3cedbff6ebaa tempest-BackendsCapabilitiesAdminTestsJSON-215480153 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87293) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 23 00:17:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-91f24b88-d75e-4780-9fd1-3f89279da04c tempest-BackendsCapabilitiesAdminTestsJSON-215480153 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87293) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Flow 'volume_create_manager' (1911f886-c224-40c4-8d26-1d91a71ad9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac62760f-6d63-49a4-96ca-f21b97c839e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac62760f-6d63-49a4-96ca-f21b97c839e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-667745204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba38d11-2f4d-43a0-9f41-3c89b95192e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677966cca8df413e9ad88a1ec88b1059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:29Z,use_quota=True,user_id='cbf871884aee48c7831d9c53c0d9a3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19595d64-2f35-4b5a-ac76-45904f9076d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19595d64-2f35-4b5a-ac76-45904f9076d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab7a13f-3a76-465d-9315-2af45203efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab7a13f-3a76-465d-9315-2af45203efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba38d11-2f4d-43a0-9f41-3c89b95192e6', 'volume_name': 'volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da74725d-4194-4e0a-8a2e-cd8a6b776549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da74725d-4194-4e0a-8a2e-cd8a6b776549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8b040c-515a-41e2-95e6-2977bef97e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:28 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Volume 8ba38d11-2f4d-43a0-9f41-3c89b95192e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6', 'volume_size': 1}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-667745204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba38d11-2f4d-43a0-9f41-3c89b95192e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677966cca8df413e9ad88a1ec88b1059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:29Z,use_quota=True,user_id='cbf871884aee48c7831d9c53c0d9a3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Creating volume 8ba38d11-2f4d-43a0-9f41-3c89b95192e6 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:28 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:17:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:28 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 1073741824
Sep 23 00:17:28 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:29 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 1073741824" returned: 0 in 1.072s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:30 devstack sudo[94077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6
Sep 23 00:17:30 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:30 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6" returned: 0 in 0.532s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8b040c-515a-41e2-95e6-2977bef97e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7c8b06-865c-420d-a73e-e83ace20f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Volume volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 (8ba38d11-2f4d-43a0-9f41-3c89b95192e6): created successfully
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7c8b06-865c-420d-a73e-e83ace20f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Flow 'volume_create_manager' (1911f886-c224-40c4-8d26-1d91a71ad9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:30 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b39ea817-3482-4f09-9318-2bb93952b576 tempest-AttachVolumeNegativeTest-36993877 None] Created volume successfully.
Sep 23 00:17:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0ac8b1ed-9e9f-403a-a38c-117da9d64fca req-9cd045d7-20d1-4d4b-821a-231478f24049 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0ac8b1ed-9e9f-403a-a38c-117da9d64fca req-9cd045d7-20d1-4d4b-821a-231478f24049 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0ac8b1ed-9e9f-403a-a38c-117da9d64fca req-9cd045d7-20d1-4d4b-821a-231478f24049 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-0ac8b1ed-9e9f-403a-a38c-117da9d64fca req-9cd045d7-20d1-4d4b-821a-231478f24049 tempest-AttachVolumeNegativeTest-36993877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '491cc8b0-9d53-4971-842f-559964172a20', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:17:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-0ac8b1ed-9e9f-403a-a38c-117da9d64fca req-9cd045d7-20d1-4d4b-821a-231478f24049 tempest-AttachVolumeNegativeTest-36993877 None] attachment_update completed successfully.
Sep 23 00:17:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-e3aaed03-70d3-4f3b-b8e8-eb0c02c37e24 req-2e831a9e-25f3-4de7-ba97-9148d9d99dae tempest-AttachVolumeNegativeTest-36993877 None] Terminate volume connection completed successfully.
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-e3aaed03-70d3-4f3b-b8e8-eb0c02c37e24 req-2e831a9e-25f3-4de7-ba97-9148d9d99dae tempest-AttachVolumeNegativeTest-36993877 None] Deleting attachment 491cc8b0-9d53-4971-842f-559964172a20. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Acquiring lock "cinder-a7e75b94-5e4e-4007-9977-fbc1033d5b86-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "cinder-a7e75b94-5e4e-4007-9977-fbc1033d5b86-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Acquiring lock "cinder-quobyte-a7e75b94-5e4e-4007-9977-fbc1033d5b86" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "cinder-quobyte-a7e75b94-5e4e-4007-9977-fbc1033d5b86" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97adfbf1-53dd-46da-9099-31211c7f8fb9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:39 devstack sudo[94624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86
Sep 23 00:17:39 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:39 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86" returned: 0 in 0.604s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:39 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86
Sep 23 00:17:39 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:40 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a7e75b94-5e4e-4007-9977-fbc1033d5b86" returned: 0 in 0.511s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:40 devstack sudo[94633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:17:40 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "cinder-quobyte-a7e75b94-5e4e-4007-9977-fbc1033d5b86" released by "delete_volume" :: held 1.240s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Created reservations ['06e6f62c-fade-4a8a-ab22-8410019812a4', 'b37bf646-fe8d-40c5-942c-15dc7a05cc3e', '6c6344bf-eb1d-4e1e-bd1d-00967f969905', 'c7462216-f91b-4bef-a4f3-66ac8559b80b', '889fbf4f-0b11-4b07-a836-cbc4ad4abd08'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:40 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:17:40 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:40 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.762s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:17:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:17:41 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 1.168s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Deleted volume successfully.
Sep 23 00:17:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5ef6b667-d5b9-4ae3-b62c-908a0086b6df tempest-ServerRescueNegativeTestJSON-247532858 None] Lock "cinder-a7e75b94-5e4e-4007-9977-fbc1033d5b86-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bf58c5c0-9f35-4479-affa-f04f5056fcca tempest-GroupsV314Test-2076099711 None] Group tempest-GroupsV314Test-Group-146922950: creating
Sep 23 00:17:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bf58c5c0-9f35-4479-affa-f04f5056fcca tempest-GroupsV314Test-2076099711 None] Group tempest-GroupsV314Test-Group-146922950: created successfully
Sep 23 00:17:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bf58c5c0-9f35-4479-affa-f04f5056fcca tempest-GroupsV314Test-2076099711 None] Create group completed successfully.
Sep 23 00:17:45 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Flow 'volume_create_manager' (91645181-b814-4edd-8f68-76b83edf5cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80ec838-677e-420f-948b-c5476898edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80ec838-677e-420f-948b-c5476898edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-315450835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f12ff9e8-5a7a-4401-8122-824599c05748,host='devstack@QuobyteHD#QuobyteHD',id=9e27e754-b520-484c-b462-fda4fb1b9622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0aaf1460c8442ada1b7d39c8d3d5bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:46Z,use_quota=True,user_id='7e0dfc0110194354aac7147f6e53456d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a85885d9-0679-4534-a05e-aebf80945c3b),volume_type_id=a85885d9-0679-4534-a05e-aebf80945c3b)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caaf9fe-86dc-4a68-9863-dfa250062603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caaf9fe-86dc-4a68-9863-dfa250062603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6774ee-c568-4047-a06f-29543b044876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6774ee-c568-4047-a06f-29543b044876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e27e754-b520-484c-b462-fda4fb1b9622', 'volume_name': 'volume-9e27e754-b520-484c-b462-fda4fb1b9622', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c27a975-ba9d-462a-a917-59037cb0fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c27a975-ba9d-462a-a917-59037cb0fa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aac4e7-67ee-4c19-b24c-447be2f7f41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:46 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Volume 9e27e754-b520-484c-b462-fda4fb1b9622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e27e754-b520-484c-b462-fda4fb1b9622', 'volume_size': 1}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f12ff9e8-5a7a-4401-8122-824599c05748,created_at=2026-09-22T22:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-315450835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f12ff9e8-5a7a-4401-8122-824599c05748,host='devstack@QuobyteHD#QuobyteHD',id=9e27e754-b520-484c-b462-fda4fb1b9622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0aaf1460c8442ada1b7d39c8d3d5bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:46Z,use_quota=True,user_id='7e0dfc0110194354aac7147f6e53456d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a85885d9-0679-4534-a05e-aebf80945c3b),volume_type_id=a85885d9-0679-4534-a05e-aebf80945c3b)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Creating volume 9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:46 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:17:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:46 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 1073741824
Sep 23 00:17:46 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:47 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 1073741824" returned: 0 in 1.057s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:47 devstack sudo[94695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622
Sep 23 00:17:47 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:48 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622" returned: 0 in 0.708s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aac4e7-67ee-4c19-b24c-447be2f7f41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e27e754-b520-484c-b462-fda4fb1b9622', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b84192e-cfa8-4324-922a-18a7411ad344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:48 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Volume volume-9e27e754-b520-484c-b462-fda4fb1b9622 (9e27e754-b520-484c-b462-fda4fb1b9622): created successfully
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b84192e-cfa8-4324-922a-18a7411ad344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Flow 'volume_create_manager' (91645181-b814-4edd-8f68-76b83edf5cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b6cb51a7-0664-40a6-8b01-a425ff9ace7c tempest-GroupsV314Test-2076099711 None] Created volume successfully.
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:50 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Cloning volume 9e27e754-b520-484c-b462-fda4fb1b9622 to volume 5d74ff48-bde0-4216-9077-09e6ff753e49
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Creating offline snapshot 97eb9150-6178-4680-9fe8-49704e6e7fc9 of volume 9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c85d895-7077-41e8-8e51-321c7e306c89]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:50 devstack sudo[94719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622
Sep 23 00:17:50 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:50 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622" returned: 0 in 0.598s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:50 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 1G
Sep 23 00:17:50 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:51 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 1G" returned: 0 in 0.772s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e27e754-b520-484c-b462-fda4fb1b9622 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:51 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e27e754-b520-484c-b462-fda4fb1b9622 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9
Sep 23 00:17:51 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:52 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e27e754-b520-484c-b462-fda4fb1b9622 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9" returned: 0 in 0.581s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:52 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:17:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:52 devstack sudo[94740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9
Sep 23 00:17:52 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:52 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9" returned: 0 in 0.454s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:52 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info
Sep 23 00:17:52 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:53 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info" returned: 0 in 0.377s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:53 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:53 devstack sudo[94746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info
Sep 23 00:17:53 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:53 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.info" returned: 0 in 0.417s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Acquiring lock "cinder-quobyte-5d74ff48-bde0-4216-9077-09e6ff753e49" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-5d74ff48-bde0-4216-9077-09e6ff753e49" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] snapshot: 97eb9150-6178-4680-9fe8-49704e6e7fc9, volume: 5d74ff48-bde0-4216-9077-09e6ff753e49,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5cf42f-ef83-4b62-a24f-7b378d6ac07d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:53 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9
Sep 23 00:17:53 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:54 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9" returned: 0 in 0.530s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e27e754-b520-484c-b462-fda4fb1b9622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acad858-adfb-4190-a1c6-ea3c31842aa4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:54 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622
Sep 23 00:17:54 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:54 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622" returned: 0 in 0.511s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:17:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:54 devstack sudo[94759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49
Sep 23 00:17:54 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:02 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=4 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:02 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=19,cinder:SELECT=30,cinder:INSERT=5 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:05 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49" returned: 0 in 10.719s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:05 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622, size 1024.00 MB, duration 10.72 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:18:05 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Converted 1024.00 MB image at 95.51 MB/s
Sep 23 00:18:05 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:18:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:05 devstack sudo[94791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49
Sep 23 00:18:05 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:05 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49" returned: 0 in 0.447s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-5d74ff48-bde0-4216-9077-09e6ff753e49" released by "_copy_volume_from_snapshot" :: held 12.361s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Acquiring lock "cinder-quobyte-97eb9150-6178-4680-9fe8-49704e6e7fc9" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-97eb9150-6178-4680-9fe8-49704e6e7fc9" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Deleting offline snapshot 97eb9150-6178-4680-9fe8-49704e6e7fc9 of volume 9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] snapshot_file for this snap is: volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f800cb0-4ad2-4e15-9c3d-4d0ee60dc9ef]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:06 devstack sudo[94797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9
Sep 23 00:18:06 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:06 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9" returned: 0 in 0.701s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e27e754-b520-484c-b462-fda4fb1b9622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f52240-2a80-41c9-83ca-9820c8f10b9d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:07 devstack sudo[94803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622
Sep 23 00:18:07 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:07 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622" returned: 0 in 1.052s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:08 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9
Sep 23 00:18:08 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:08 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9" returned: 0 in 0.825s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:08 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9
Sep 23 00:18:08 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:09 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622.97eb9150-6178-4680-9fe8-49704e6e7fc9" returned: 0 in 0.424s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-97eb9150-6178-4680-9fe8-49704e6e7fc9" released by "_delete_snapshot" :: held 3.232s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.140s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ca8f1441-f0c8-41cf-a6bb-e13a6c934568 tempest-GroupsV314Test-2076099711 None] Create group from source-group-f12ff9e8-5a7a-4401-8122-824599c05748 completed successfully.
Sep 23 00:18:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Acquiring lock "cinder-quobyte-5d74ff48-bde0-4216-9077-09e6ff753e49" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-5d74ff48-bde0-4216-9077-09e6ff753e49" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd77b69a-425c-4565-aedd-46015f9a7259]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:11 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49
Sep 23 00:18:11 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:11 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49" returned: 0 in 0.669s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:11 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49
Sep 23 00:18:11 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:12 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d74ff48-bde0-4216-9077-09e6ff753e49" returned: 0 in 0.608s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-5d74ff48-bde0-4216-9077-09e6ff753e49" released by "delete_volume" :: held 1.382s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Created reservations ['cc15ab0c-cef6-4d57-8c53-2f8fbc088a21'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:12 devstack cinder-volume[87293]: WARNING cinder.quota [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-969994038 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-969994038, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:12 devstack cinder-volume[87293]: WARNING cinder.quota [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-969994038 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-969994038, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Created reservations ['65dd4268-c75f-4de7-a6ef-1ca08ea97051', 'da274465-96db-4aa8-bd60-35f54c1f9e86', '37aeef30-eb10-47b8-bce9-99a71fcec85e', '38dd7256-7933-412b-a3fc-6787ef4507b8', '1eef08e2-2e0f-4c66-92b0-b772e9c27cc4'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:13 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:13 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:13 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.724s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:13 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a312d21f-0981-4973-b726-38b9a730da6e tempest-GroupsV314Test-2076099711 None] Delete group completed successfully.
Sep 23 00:18:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Acquiring lock "cinder-quobyte-9e27e754-b520-484c-b462-fda4fb1b9622" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-9e27e754-b520-484c-b462-fda4fb1b9622" acquired by "delete_volume" :: waited 0.092s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a8edb-f526-4a03-be0b-f1a18b432681]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:15 devstack sudo[94959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622
Sep 23 00:18:15 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:16 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622" returned: 0 in 1.453s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:16 devstack sudo[94974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622
Sep 23 00:18:16 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:17 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e27e754-b520-484c-b462-fda4fb1b9622" returned: 0 in 0.758s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Lock "cinder-quobyte-9e27e754-b520-484c-b462-fda4fb1b9622" released by "delete_volume" :: held 2.397s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Created reservations ['72c1273f-3bec-41a5-8c57-cc7e07dca5e3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Created reservations ['17ecb2da-ba74-419a-8cc7-2888b1d2f3cb', '0e459ef2-cff2-4bdb-b3ee-05609a44d5f0', '0bc027a3-5073-4143-a24a-01eacdf7aa7e', '507db55a-2145-44ab-8ff9-1f9cc62446e1', '3a5748aa-114b-4439-812a-323b01185876'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:17 devstack sudo[94986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:17 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:18 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.517s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:18 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7485d4cb-d45e-4ab9-ae9f-5dc45e494f02 tempest-GroupsV314Test-2076099711 None] Delete group completed successfully.
Sep 23 00:18:27 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=26,cinder:SELECT=22,cinder:INSERT=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:27 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=27,cinder:SELECT=18,cinder:INSERT=9 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Flow 'volume_create_manager' (dccf3f0b-e83e-4760-a5f5-b331c36d9c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1811e9fd-a0c1-4d60-b6b6-b288cf8588f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1811e9fd-a0c1-4d60-b6b6-b288cf8588f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-122666879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b8cc21-d14f-46dc-80e0-16c005c646b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e527c34119cc4b29bd60952114af50bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:33Z,use_quota=True,user_id='f57f613e520c4e0187f3c84defbf14c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6d316a-50f8-493e-84a6-87dac8a6776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6d316a-50f8-493e-84a6-87dac8a6776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57fc055-083b-4007-b2d8-1e2ada4d1d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57fc055-083b-4007-b2d8-1e2ada4d1d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b8cc21-d14f-46dc-80e0-16c005c646b5', 'volume_name': 'volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae630a9-d60b-42de-a505-7f35f2826d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae630a9-d60b-42de-a505-7f35f2826d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14837d6-e697-46bd-bd94-800e7cceb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Volume a4b8cc21-d14f-46dc-80e0-16c005c646b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5', 'volume_size': 1}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-122666879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b8cc21-d14f-46dc-80e0-16c005c646b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e527c34119cc4b29bd60952114af50bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:33Z,use_quota=True,user_id='f57f613e520c4e0187f3c84defbf14c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Creating volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:33 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:33 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 1073741824
Sep 23 00:18:33 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-86b210c6-918e-4e12-bae0-c6e875d771d1 tempest-GroupsTest-1652101156 None] Group tempest-Group1-864454001: creating
Sep 23 00:18:33 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-86b210c6-918e-4e12-bae0-c6e875d771d1 tempest-GroupsTest-1652101156 None] Group tempest-Group1-864454001: created successfully
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 1073741824" returned: 0 in 0.592s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-86b210c6-918e-4e12-bae0-c6e875d771d1 tempest-GroupsTest-1652101156 None] Create group completed successfully.
Sep 23 00:18:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:33 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5
Sep 23 00:18:33 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:34 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5" returned: 0 in 0.348s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14837d6-e697-46bd-bd94-800e7cceb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2866bd37-73cd-471a-a635-ad87c712a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:34 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Volume volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 (a4b8cc21-d14f-46dc-80e0-16c005c646b5): created successfully
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2866bd37-73cd-471a-a635-ad87c712a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Flow 'volume_create_manager' (dccf3f0b-e83e-4760-a5f5-b331c36d9c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-132171f5-922a-4c15-bbf1-a37375454c91 tempest-SnapshotsActionsTest-328233182 None] Created volume successfully.
Sep 23 00:18:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fe403aae-3f9a-4061-9fb7-fef8e16541c5 tempest-GroupsTest-1652101156 None] Group tempest-Group2-1184969148: creating
Sep 23 00:18:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fe403aae-3f9a-4061-9fb7-fef8e16541c5 tempest-GroupsTest-1652101156 None] Group tempest-Group2-1184969148: created successfully
Sep 23 00:18:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fe403aae-3f9a-4061-9fb7-fef8e16541c5 tempest-GroupsTest-1652101156 None] Create group completed successfully.
Sep 23 00:18:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Creating offline snapshot ce453223-46e9-4939-a71e-b5e1326e495d of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:18:35 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[20160c99-9088-4934-9b2e-eddf63c9316e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:35 devstack sudo[95123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5
Sep 23 00:18:35 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:36 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5" returned: 0 in 0.535s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:36 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d 1G
Sep 23 00:18:36 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:36 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d 1G" returned: 0 in 0.607s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:36 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:36 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Flow 'volume_create_manager' (db268025-4ba6-4969-a20e-db57282a5505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c3faf2-7b38-4fef-8ef3-1fadbaf67c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c3faf2-7b38-4fef-8ef3-1fadbaf67c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1121731302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d39a0bfc-cd49-4e72-b496-a20e0d086c0f,host='devstack@QuobyteHD#QuobyteHD',id=4b471fb9-c7d0-4968-9652-1286bc0ce588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762b0fed90f14175b4b0d9787e6a6a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:37Z,use_quota=True,user_id='a1ee0f879b084ff8b005a2e484e212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf51e5e7-3cb5-45d9-be05-a4950f7e37d4),volume_type_id=cf51e5e7-3cb5-45d9-be05-a4950f7e37d4)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba36486-2535-44e2-98a8-2dc52ac26a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba36486-2535-44e2-98a8-2dc52ac26a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:37 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f94dbd-5e24-44ce-a717-0ccbf56679b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f94dbd-5e24-44ce-a717-0ccbf56679b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b471fb9-c7d0-4968-9652-1286bc0ce588', 'volume_name': 'volume-4b471fb9-c7d0-4968-9652-1286bc0ce588', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0085a09-fc19-45e4-a715-34a63af40191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0085a09-fc19-45e4-a715-34a63af40191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b20e4e-1237-4289-9d82-5df7a403b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Volume 4b471fb9-c7d0-4968-9652-1286bc0ce588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b471fb9-c7d0-4968-9652-1286bc0ce588', 'volume_size': 1}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.553s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:37 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d is being set with open permissions: ugo+rw
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:37 devstack sudo[95140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:37 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:37 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:37 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info
Sep 23 00:18:37 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:38 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info" returned: 0 in 0.295s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:38 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info is being set with open permissions: ugo+rw
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:38 devstack sudo[95146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info
Sep 23 00:18:38 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:38 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.info" returned: 0 in 0.377s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d39a0bfc-cd49-4e72-b496-a20e0d086c0f,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1121731302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d39a0bfc-cd49-4e72-b496-a20e0d086c0f,host='devstack@QuobyteHD#QuobyteHD',id=4b471fb9-c7d0-4968-9652-1286bc0ce588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762b0fed90f14175b4b0d9787e6a6a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:37Z,use_quota=True,user_id='a1ee0f879b084ff8b005a2e484e212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf51e5e7-3cb5-45d9-be05-a4950f7e37d4),volume_type_id=cf51e5e7-3cb5-45d9-be05-a4950f7e37d4)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Creating volume 4b471fb9-c7d0-4968-9652-1286bc0ce588 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:38 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:18:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:38 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 1073741824
Sep 23 00:18:38 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6f03a39e-2b9f-471c-b2b2-f73e1d7d22f2 tempest-SnapshotsActionsTest-328233182 None] Create snapshot completed successfully
Sep 23 00:18:39 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 1073741824" returned: 0 in 0.737s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:39 devstack sudo[95155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588
Sep 23 00:18:39 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:39 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588" returned: 0 in 0.487s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b20e4e-1237-4289-9d82-5df7a403b63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b471fb9-c7d0-4968-9652-1286bc0ce588', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a86143-5e88-41e3-b3d3-3b3ab3715549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Volume volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 (4b471fb9-c7d0-4968-9652-1286bc0ce588): created successfully
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a86143-5e88-41e3-b3d3-3b3ab3715549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Flow 'volume_create_manager' (db268025-4ba6-4969-a20e-db57282a5505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5398f0a5-f93d-41ad-b7c4-e6a8c441c820 tempest-GroupsTest-1652101156 None] Created volume successfully.
Sep 23 00:18:40 devstack sudo[95158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:40 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Creating offline snapshot 65aa0140-d68d-4fae-9016-2dc742640303 of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b554bc-aa21-4fd2-9d7c-1be829466e51]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:40 devstack sudo[95160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:40 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:40 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:18:40 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.495s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:40 devstack sudo[95167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 1G
Sep 23 00:18:40 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:41 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 1G" returned: 0 in 0.757s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:41 devstack sudo[95175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303
Sep 23 00:18:41 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:41 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303" returned: 0 in 0.479s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:41 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 is being set with open permissions: ugo+rw
Sep 23 00:18:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:41 devstack sudo[95180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303
Sep 23 00:18:41 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Acquiring lock "cinder-quobyte-4b471fb9-c7d0-4968-9652-1286bc0ce588" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Lock "cinder-quobyte-4b471fb9-c7d0-4968-9652-1286bc0ce588" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1332ad-ff45-44d8-ba38-73335fba0560]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:42 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:42 devstack sudo[95183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588
Sep 23 00:18:42 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Flow 'volume_create_manager' (7b89f67b-bd16-41ea-ad31-b5f07d6661e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021e68c-f833-4860-9056-d908a487be9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021e68c-f833-4860-9056-d908a487be9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-613281278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c378f1-5a88-4eac-995d-20c145711305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677966cca8df413e9ad88a1ec88b1059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:42Z,use_quota=True,user_id='cbf871884aee48c7831d9c53c0d9a3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38987395-351c-4b38-9112-e81e52d65c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38987395-351c-4b38-9112-e81e52d65c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de846e25-0532-445a-8998-47468ad179b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de846e25-0532-445a-8998-47468ad179b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c378f1-5a88-4eac-995d-20c145711305', 'volume_name': 'volume-14c378f1-5a88-4eac-995d-20c145711305', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784171dd-566e-421e-a8bf-083056820a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784171dd-566e-421e-a8bf-083056820a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af00c625-9608-4c4e-b3ce-210c695f71be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Volume 14c378f1-5a88-4eac-995d-20c145711305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c378f1-5a88-4eac-995d-20c145711305', 'volume_size': 1}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-613281278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c378f1-5a88-4eac-995d-20c145711305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677966cca8df413e9ad88a1ec88b1059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:42Z,use_quota=True,user_id='cbf871884aee48c7831d9c53c0d9a3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Creating volume 14c378f1-5a88-4eac-995d-20c145711305 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:42 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2c367b65-cd81-489e-9afc-0c63ff058856 tempest-SnapshotsActionsTest-328233182 None] Create snapshot completed successfully
Sep 23 00:18:42 devstack sudo[95206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305 1073741824
Sep 23 00:18:42 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:42 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588" returned: 0 in 0.553s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:42 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588
Sep 23 00:18:42 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:43 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b471fb9-c7d0-4968-9652-1286bc0ce588" returned: 0 in 0.353s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:43 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305 1073741824" returned: 0 in 0.603s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Lock "cinder-quobyte-4b471fb9-c7d0-4968-9652-1286bc0ce588" released by "delete_volume" :: held 0.993s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:43 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305
Sep 23 00:18:43 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Created reservations ['e7a55883-85f2-4427-8d67-d200312d5897'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:43 devstack cinder-volume[87293]: WARNING cinder.quota [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2105058946 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2105058946, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:43 devstack cinder-volume[87293]: WARNING cinder.quota [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2105058946 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2105058946, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Created reservations ['7e05c8d5-681a-4c0a-b674-051f0c524c48', '3c4ed03c-b784-4b43-ba70-b072992fd9e3', '42913154-6e23-4ed1-a82c-6db713347a20', 'e18b2c25-2530-4278-ada8-dfa4fb3df83b', '923f54db-037e-4834-9150-103555c94966'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-65aa0140-d68d-4fae-9016-2dc742640303-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-65aa0140-d68d-4fae-9016-2dc742640303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-65aa0140-d68d-4fae-9016-2dc742640303" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-65aa0140-d68d-4fae-9016-2dc742640303" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:43 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:43 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Deleting offline snapshot 65aa0140-d68d-4fae-9016-2dc742640303 of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:18:43 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] snapshot_file for this snap is: volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305" returned: 0 in 0.407s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848a947-dedb-4ac2-8abc-8361b4f87c7b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af00c625-9608-4c4e-b3ce-210c695f71be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c378f1-5a88-4eac-995d-20c145711305', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af281d9-8f00-4ee6-8530-0ee9154379f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Volume volume-14c378f1-5a88-4eac-995d-20c145711305 (14c378f1-5a88-4eac-995d-20c145711305): created successfully
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af281d9-8f00-4ee6-8530-0ee9154379f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Flow 'volume_create_manager' (7b89f67b-bd16-41ea-ad31-b5f07d6661e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-730db07a-ac83-4ce5-8d11-3c784a051a7d tempest-AttachVolumeNegativeTest-36993877 None] Created volume successfully.
Sep 23 00:18:43 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303
Sep 23 00:18:43 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:43 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.313s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:43 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-71ef9d05-b16c-4ae6-8262-b25571f65900 tempest-GroupsTest-1652101156 None] Delete group completed successfully.
Sep 23 00:18:44 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303" returned: 0 in 0.497s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6e25ff-107a-4d4d-a423-3c5483fa5417]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:44 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:44 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:44 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.556s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:44 devstack sudo[95237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303
Sep 23 00:18:44 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:44 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Created reservations ['19666787-a041-4e4a-85e7-aa78297ea5ce'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:45 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:45 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:45 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.308s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9f151785-a745-419a-a1fb-edeaa162ae0b tempest-GroupsTest-1652101156 None] Delete group completed successfully.
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-9a87261d-1481-4994-9037-bb7a7c6af16d req-2a79ac2a-ff7a-42cf-ab3b-aad152ac2205 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-9a87261d-1481-4994-9037-bb7a7c6af16d req-2a79ac2a-ff7a-42cf-ab3b-aad152ac2205 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:45 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-9a87261d-1481-4994-9037-bb7a7c6af16d req-2a79ac2a-ff7a-42cf-ab3b-aad152ac2205 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303" returned: 0 in 0.609s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:45 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303
Sep 23 00:18:45 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-9a87261d-1481-4994-9037-bb7a7c6af16d req-2a79ac2a-ff7a-42cf-ab3b-aad152ac2205 tempest-AttachVolumeNegativeTest-36993877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-14c378f1-5a88-4eac-995d-20c145711305', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3058143e-93a1-4032-aa7c-79a27c69413c', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:18:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-9a87261d-1481-4994-9037-bb7a7c6af16d req-2a79ac2a-ff7a-42cf-ab3b-aad152ac2205 tempest-AttachVolumeNegativeTest-36993877 None] attachment_update completed successfully.
Sep 23 00:18:45 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.65aa0140-d68d-4fae-9016-2dc742640303" returned: 0 in 0.327s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-65aa0140-d68d-4fae-9016-2dc742640303" released by "_delete_snapshot" :: held 2.151s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" released by "delete_snapshot" :: held 2.206s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:45 devstack cinder-volume[87293]: WARNING cinder.quota [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Created reservations ['4dfd0559-7797-4460-9c6f-bd8f81bf42bd', '637c6942-2855-4792-bc69-f1c4de31ac8a', 'b2620f2c-7e9d-429a-b98c-5efd95a9bd4f', '51544822-5e79-4d28-babc-c094a4df854e', '9e33e2b5-d9a6-4e25-916c-b76d6d7bfad7'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Delete snapshot completed successfully.
Sep 23 00:18:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a32f8c16-5a77-485d-8d20-7c70d0cad928 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-65aa0140-d68d-4fae-9016-2dc742640303-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c339f077-f97d-4695-9347-d45e87a0fae3 tempest-GroupsTest-1652101156 None] Group tempest-GroupsTest-Group-342675560: creating
Sep 23 00:18:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c339f077-f97d-4695-9347-d45e87a0fae3 tempest-GroupsTest-1652101156 None] Group tempest-GroupsTest-Group-342675560: created successfully
Sep 23 00:18:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c339f077-f97d-4695-9347-d45e87a0fae3 tempest-GroupsTest-1652101156 None] Create group completed successfully.
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Creating offline snapshot 10b800d8-4bbe-44d7-aa89-cc2aad751235 of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80fd891-734c-49d4-8b77-1189ec27853c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:47 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:47 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:47 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.438s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:47 devstack sudo[95675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 1G
Sep 23 00:18:47 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-c03afba3-9a94-41cf-89e2-4e8fd3ce71d8 req-3ee84cd8-ce2d-4913-8b8b-fa34dc8b8cdd tempest-AttachVolumeNegativeTest-36993877 None] Terminate volume connection completed successfully.
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-c03afba3-9a94-41cf-89e2-4e8fd3ce71d8 req-3ee84cd8-ce2d-4913-8b8b-fa34dc8b8cdd tempest-AttachVolumeNegativeTest-36993877 None] Deleting attachment 3058143e-93a1-4032-aa7c-79a27c69413c. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:18:48 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 1G" returned: 0 in 0.727s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:48 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235
Sep 23 00:18:48 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Flow 'volume_create_manager' (a6fc98a9-7bd2-459d-9388-f875af55293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146acf2d-9c26-4f4e-89c5-cf9d9125cc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146acf2d-9c26-4f4e-89c5-cf9d9125cc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-679337628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=87c85526-5aea-4dfb-a1c0-167ea718198a,host='devstack@QuobyteHD#QuobyteHD',id=fa8c2058-8e29-4573-9ea4-c629e90fb36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762b0fed90f14175b4b0d9787e6a6a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:49Z,use_quota=True,user_id='a1ee0f879b084ff8b005a2e484e212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d887e41-2dd1-448a-9353-b437a5c811bd),volume_type_id=0d887e41-2dd1-448a-9353-b437a5c811bd)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb155775-d50e-4f25-b0ac-1e3fcf9d728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb155775-d50e-4f25-b0ac-1e3fcf9d728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f335a4-e409-4fdd-98df-b75941e705ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f335a4-e409-4fdd-98df-b75941e705ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8c2058-8e29-4573-9ea4-c629e90fb36b', 'volume_name': 'volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb752118-ee3f-4703-af8b-73c33d56808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb752118-ee3f-4703-af8b-73c33d56808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3be9ba-20af-4895-9bea-a3aaad833fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:48 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Volume fa8c2058-8e29-4573-9ea4-c629e90fb36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b', 'volume_size': 1}
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:48 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235" returned: 0 in 0.413s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:48 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 is being set with open permissions: ugo+rw
Sep 23 00:18:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:48 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235
Sep 23 00:18:48 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:49 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235" returned: 0 in 0.300s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=87c85526-5aea-4dfb-a1c0-167ea718198a,created_at=2026-09-22T22:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-679337628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=87c85526-5aea-4dfb-a1c0-167ea718198a,host='devstack@QuobyteHD#QuobyteHD',id=fa8c2058-8e29-4573-9ea4-c629e90fb36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762b0fed90f14175b4b0d9787e6a6a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:49Z,use_quota=True,user_id='a1ee0f879b084ff8b005a2e484e212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d887e41-2dd1-448a-9353-b437a5c811bd),volume_type_id=0d887e41-2dd1-448a-9353-b437a5c811bd)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Creating volume fa8c2058-8e29-4573-9ea4-c629e90fb36b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:49 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:18:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:49 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b 1073741824
Sep 23 00:18:49 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6b900c4d-ba03-45fa-83af-f502ba56a139 tempest-SnapshotsActionsTest-328233182 None] Create snapshot completed successfully
Sep 23 00:18:50 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b 1073741824" returned: 0 in 0.778s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:50 devstack sudo[95741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b
Sep 23 00:18:50 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:50 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b" returned: 0 in 0.392s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3be9ba-20af-4895-9bea-a3aaad833fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7517c1e9-f01c-41a0-903a-ac381d2fcc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:50 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Volume volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b (fa8c2058-8e29-4573-9ea4-c629e90fb36b): created successfully
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7517c1e9-f01c-41a0-903a-ac381d2fcc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Flow 'volume_create_manager' (a6fc98a9-7bd2-459d-9388-f875af55293b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8dbd5e11-3460-4c31-8e7f-d339a0c7acdc tempest-GroupsTest-1652101156 None] Created volume successfully.
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-10b800d8-4bbe-44d7-aa89-cc2aad751235-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-10b800d8-4bbe-44d7-aa89-cc2aad751235-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-10b800d8-4bbe-44d7-aa89-cc2aad751235" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-10b800d8-4bbe-44d7-aa89-cc2aad751235" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Deleting offline snapshot 10b800d8-4bbe-44d7-aa89-cc2aad751235 of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] snapshot_file for this snap is: volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657dd24-5ea0-4355-8cc7-95f05a69c9cf]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:51 devstack sudo[95746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235
Sep 23 00:18:51 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:51 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235" returned: 0 in 0.623s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:51 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed9e34-2457-48da-a86d-0b6b51c80f8c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:51 devstack sudo[95754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:51 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:52 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.659s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:52 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235
Sep 23 00:18:52 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Flow 'volume_create_manager' (bf878377-9424-411a-8927-454975c446ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5df593-bd94-4d51-8d00-63bdd6c4892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5df593-bd94-4d51-8d00-63bdd6c4892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386521621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=87c85526-5aea-4dfb-a1c0-167ea718198a,host='devstack@QuobyteHD#QuobyteHD',id=64126712-b712-4473-9542-0a2dbcf5b5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762b0fed90f14175b4b0d9787e6a6a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:53Z,use_quota=True,user_id='a1ee0f879b084ff8b005a2e484e212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d887e41-2dd1-448a-9353-b437a5c811bd),volume_type_id=0d887e41-2dd1-448a-9353-b437a5c811bd)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d5a0ba-ba6a-4fe6-ab58-018659c2dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d5a0ba-ba6a-4fe6-ab58-018659c2dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15728f0a-527b-4fde-b291-5c21611beae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15728f0a-527b-4fde-b291-5c21611beae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64126712-b712-4473-9542-0a2dbcf5b5c9', 'volume_name': 'volume-64126712-b712-4473-9542-0a2dbcf5b5c9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fde14ef-bdd0-47a7-8971-86f4eacdb8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fde14ef-bdd0-47a7-8971-86f4eacdb8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8f3048-2645-4ce0-a3a9-e75e15af7037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Volume 64126712-b712-4473-9542-0a2dbcf5b5c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64126712-b712-4473-9542-0a2dbcf5b5c9', 'volume_size': 1}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=87c85526-5aea-4dfb-a1c0-167ea718198a,created_at=2026-09-22T22:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386521621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=87c85526-5aea-4dfb-a1c0-167ea718198a,host='devstack@QuobyteHD#QuobyteHD',id=64126712-b712-4473-9542-0a2dbcf5b5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762b0fed90f14175b4b0d9787e6a6a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:53Z,use_quota=True,user_id='a1ee0f879b084ff8b005a2e484e212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d887e41-2dd1-448a-9353-b437a5c811bd),volume_type_id=0d887e41-2dd1-448a-9353-b437a5c811bd)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Creating volume 64126712-b712-4473-9542-0a2dbcf5b5c9 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:52 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:18:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:52 devstack sudo[95764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9 1073741824
Sep 23 00:18:52 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:53 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235" returned: 0 in 0.811s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:53 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235
Sep 23 00:18:53 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:53 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9 1073741824" returned: 0 in 0.672s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:53 devstack sudo[95775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9
Sep 23 00:18:53 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:53 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.10b800d8-4bbe-44d7-aa89-cc2aad751235" returned: 0 in 0.458s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-10b800d8-4bbe-44d7-aa89-cc2aad751235" released by "_delete_snapshot" :: held 2.762s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" released by "delete_snapshot" :: held 2.804s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Created reservations ['74c746ac-c6c3-427c-a779-7ff8a34bedc6', '74fa7047-c592-402a-b2b1-772a0100b73f', '237770ce-df25-4655-9e91-cd73c1ad0cba', 'f38da38a-bac2-4ee5-b0cc-fdbe556343de', '03dd2a27-b141-423c-a3f4-6bbd289cc4c5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Delete snapshot completed successfully.
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-91d373f9-9c9e-478d-9645-8821284905a6 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-10b800d8-4bbe-44d7-aa89-cc2aad751235-delete_snapshot" released by "delete_snapshot" :: held 3.034s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:53 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9" returned: 0 in 0.304s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8f3048-2645-4ce0-a3a9-e75e15af7037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64126712-b712-4473-9542-0a2dbcf5b5c9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44c70e9-314b-417f-81fb-14eae2c07c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:53 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Volume volume-64126712-b712-4473-9542-0a2dbcf5b5c9 (64126712-b712-4473-9542-0a2dbcf5b5c9): created successfully
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44c70e9-314b-417f-81fb-14eae2c07c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Flow 'volume_create_manager' (bf878377-9424-411a-8927-454975c446ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f28b7ece-45d6-4084-9033-09f88716820f tempest-GroupsTest-1652101156 None] Created volume successfully.
Sep 23 00:18:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Creating offline snapshot c39c650e-a659-4701-8333-04dea1bac1bc of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:18:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8865986b-5eaf-4f67-ad35-f9a1d3499bae]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:54 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:54 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "cinder-14c378f1-5a88-4eac-995d-20c145711305-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-14c378f1-5a88-4eac-995d-20c145711305-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "cinder-quobyte-14c378f1-5a88-4eac-995d-20c145711305" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-quobyte-14c378f1-5a88-4eac-995d-20c145711305" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5eb884-2a78-4876-b78f-3accc2e98b5f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:55 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.599s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:55 devstack sudo[95784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc 1G
Sep 23 00:18:55 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:55 devstack sudo[95783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305
Sep 23 00:18:55 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8d1a7b45-7281-487a-9ed4-21d9fa28bfad tempest-GroupsTest-1652101156 None] Update group completed successfully.
Sep 23 00:18:55 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305" returned: 0 in 0.450s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:55 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305
Sep 23 00:18:55 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:55 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc 1G" returned: 0 in 0.586s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:55 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc
Sep 23 00:18:55 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:55 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-14c378f1-5a88-4eac-995d-20c145711305" returned: 0 in 0.277s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-quobyte-14c378f1-5a88-4eac-995d-20c145711305" released by "delete_volume" :: held 0.788s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Created reservations ['1b84b0bf-b292-4c97-b50f-f7870581ef68', '744cbae5-fd74-4f39-af73-e8067a01f892', '036ac221-1de2-4f16-a3f2-f5f73853a2ce', '47eeafda-ce6e-49c1-89d0-1239cbe2fc55', 'd3b9c2cd-f26c-40e1-b285-f694b60e81a1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:56 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:56 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:56 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:56 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc is being set with open permissions: ugo+rw
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:56 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc
Sep 23 00:18:56 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "cinder-8ba38d11-2f4d-43a0-9f41-3c89b95192e6-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-8ba38d11-2f4d-43a0-9f41-3c89b95192e6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:56 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.392s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:56 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Deleted volume successfully.
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "cinder-quobyte-8ba38d11-2f4d-43a0-9f41-3c89b95192e6" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:56 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc" returned: 0 in 0.364s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea5b2b3-7267-47ac-96d0-a23de8044bb6 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-14c378f1-5a88-4eac-995d-20c145711305-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-quobyte-8ba38d11-2f4d-43a0-9f41-3c89b95192e6" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c5d2a-7f51-4587-8c22-cdf5b15ecec1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:56 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2e1b9f7c-1f7e-41c9-85e6-d7eaaecf1645 tempest-SnapshotsActionsTest-328233182 None] Create snapshot completed successfully
Sep 23 00:18:56 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6
Sep 23 00:18:56 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:56 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bc4a8191-0232-4af5-978d-6a5f9c2848c7 tempest-GroupsTest-1652101156 None] Update group completed successfully.
Sep 23 00:18:57 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6" returned: 0 in 0.443s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:57 devstack sudo[95815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6
Sep 23 00:18:57 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:57 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8ba38d11-2f4d-43a0-9f41-3c89b95192e6" returned: 0 in 0.271s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-quobyte-8ba38d11-2f4d-43a0-9f41-3c89b95192e6" released by "delete_volume" :: held 0.782s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Created reservations ['82f1c5c1-8cc4-472b-a0c7-06cdb61b8b38', 'bc3adde4-62d5-4be1-8ac8-328ee0030152', '43c5930d-2fdf-40f1-97c5-bc546d3632f9', '75a3b2a7-3476-4027-ab93-751d79709d0c', '44eecc0c-edf2-40ef-b2e1-8d60b013fd8f'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:57 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:57 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "cinder-a87f09dd-e6c1-4df9-9016-82b332fb1ff2-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-a87f09dd-e6c1-4df9-9016-82b332fb1ff2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:58 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Deleted volume successfully.
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-04ee94f8-b8d6-4eb3-ab9e-ba67f8b18dc1 tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-8ba38d11-2f4d-43a0-9f41-3c89b95192e6-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "cinder-quobyte-a87f09dd-e6c1-4df9-9016-82b332fb1ff2" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-quobyte-a87f09dd-e6c1-4df9-9016-82b332fb1ff2" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8790dc78-0211-4340-aba8-b6aa2ea46810]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-c39c650e-a659-4701-8333-04dea1bac1bc-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-c39c650e-a659-4701-8333-04dea1bac1bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-c39c650e-a659-4701-8333-04dea1bac1bc" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:58 devstack sudo[95825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2
Sep 23 00:18:58 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-c39c650e-a659-4701-8333-04dea1bac1bc" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Deleting offline snapshot c39c650e-a659-4701-8333-04dea1bac1bc of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] snapshot_file for this snap is: volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a287d-add3-4195-a68e-57f5ce2b9cec]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Flow 'volume_create_manager' (1bac03fd-82f3-4dc5-8744-8341cac970cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb4b5db-4e02-4c32-8f8d-71f5fee20b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb4b5db-4e02-4c32-8f8d-71f5fee20b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1295183057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f3d6a2-cd17-45ce-9c03-018aefd296c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d236b70b49d947f388329e8d44a60dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:58Z,use_quota=True,user_id='862e73beca2b434180377ce2d29de1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b78093d-133f-4caf-88db-6dce5470a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b78093d-133f-4caf-88db-6dce5470a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b34da9-992c-4f34-ad8d-572be73d1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b34da9-992c-4f34-ad8d-572be73d1279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f3d6a2-cd17-45ce-9c03-018aefd296c9', 'volume_name': 'volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb29d0c4-675d-4833-bca4-26c3ad30a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb29d0c4-675d-4833-bca4-26c3ad30a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71457c96-6b38-4dae-929d-36872e9f9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Volume d5f3d6a2-cd17-45ce-9c03-018aefd296c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9', 'volume_size': 1}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1295183057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f3d6a2-cd17-45ce-9c03-018aefd296c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d236b70b49d947f388329e8d44a60dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:58Z,use_quota=True,user_id='862e73beca2b434180377ce2d29de1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Creating volume d5f3d6a2-cd17-45ce-9c03-018aefd296c9 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:58 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:58 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc
Sep 23 00:18:58 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:58 devstack sudo[95830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 1073741824
Sep 23 00:18:58 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:58 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2" returned: 0 in 0.610s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:58 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2
Sep 23 00:18:58 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc" returned: 0 in 0.545s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ee063-5830-4912-8593-ccb09cb1b54b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:59 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a87f09dd-e6c1-4df9-9016-82b332fb1ff2" returned: 0 in 0.363s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Acquiring lock "cinder-quobyte-64126712-b712-4473-9542-0a2dbcf5b5c9" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-quobyte-a87f09dd-e6c1-4df9-9016-82b332fb1ff2" released by "delete_volume" :: held 1.085s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Lock "cinder-quobyte-64126712-b712-4473-9542-0a2dbcf5b5c9" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e62d99-1b0b-4235-9d6d-09178a8b5d2d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:59 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack sudo[95846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:18:59 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 1073741824" returned: 0 in 0.694s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Created reservations ['f4f05f8c-829c-4c49-ba36-34a3044945d9', 'e7a36bfc-e43f-4e58-98dd-1bce3e9d3574', '51dd7ceb-0f49-4a6b-808b-0d4bd9373b87', '698b0bf0-e2e1-4263-b433-10fc9b095293', '6a81848d-ed69-44b2-b750-39bc059cd4f6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:59 devstack sudo[95849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9
Sep 23 00:18:59 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:59 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9
Sep 23 00:18:59 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack sudo[95851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:18:59 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.641s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:59 devstack sudo[95858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc
Sep 23 00:18:59 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.310s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Deleted volume successfully.
Sep 23 00:18:59 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9" returned: 0 in 0.476s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcf62b31-f25a-4cb4-931f-e94ec0bf62fe tempest-AttachVolumeNegativeTest-36993877 None] Lock "cinder-a87f09dd-e6c1-4df9-9016-82b332fb1ff2-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71457c96-6b38-4dae-929d-36872e9f9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fd7f4b-23a5-4270-b33c-c022f4070922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Volume volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 (d5f3d6a2-cd17-45ce-9c03-018aefd296c9): created successfully
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fd7f4b-23a5-4270-b33c-c022f4070922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Flow 'volume_create_manager' (1bac03fd-82f3-4dc5-8744-8341cac970cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-568405b4-e698-4141-99ff-0fdf838c5012 tempest-AttachVolumeShelveTestJSON-1819111500 None] Created volume successfully.
Sep 23 00:19:00 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9" returned: 0 in 0.692s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:00 devstack sudo[95865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9
Sep 23 00:19:00 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:00 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc" returned: 0 in 0.493s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:00 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc
Sep 23 00:19:00 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:00 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-64126712-b712-4473-9542-0a2dbcf5b5c9" returned: 0 in 0.327s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Lock "cinder-quobyte-64126712-b712-4473-9542-0a2dbcf5b5c9" released by "delete_volume" :: held 1.101s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Acquiring lock "cinder-quobyte-fa8c2058-8e29-4573-9ea4-c629e90fb36b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Lock "cinder-quobyte-fa8c2058-8e29-4573-9ea4-c629e90fb36b" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f716a-4148-4594-9eb1-52b7ac123248]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:00 devstack sudo[95873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b
Sep 23 00:19:00 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:00 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.c39c650e-a659-4701-8333-04dea1bac1bc" returned: 0 in 0.369s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-c39c650e-a659-4701-8333-04dea1bac1bc" released by "_delete_snapshot" :: held 2.223s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" released by "delete_snapshot" :: held 2.306s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Created reservations ['b0bf0091-5b53-40be-b628-d4e72a619f4a', 'e9949545-555c-4bd9-b82c-01a4f033815a', '1a45b6f2-a1d5-4246-b84e-c6527cda02f8', 'a2c78e98-fdc8-4403-98d1-d74af6e48abe', '15eed261-3e3f-44e9-b986-e9078eec3bea'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Delete snapshot completed successfully.
Sep 23 00:19:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad00838d-049d-4491-b237-e9634f0aa49c tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-c39c650e-a659-4701-8333-04dea1bac1bc-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:01 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b" returned: 0 in 0.535s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:01 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b
Sep 23 00:19:01 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:01 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fa8c2058-8e29-4573-9ea4-c629e90fb36b" returned: 0 in 0.321s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Lock "cinder-quobyte-fa8c2058-8e29-4573-9ea4-c629e90fb36b" released by "delete_volume" :: held 0.927s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Created reservations ['21311430-d71d-4fdb-9c44-9a400f9e7473'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:01 devstack cinder-volume[87293]: WARNING cinder.quota [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1322184437 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1322184437, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:19:01 devstack cinder-volume[87293]: WARNING cinder.quota [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1322184437 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1322184437, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Created reservations ['c9246a79-5507-4787-8b50-81b287ae5da7', '61771972-f11f-4194-bb43-9bcc1764e885', 'cba8d112-74ba-4438-ad16-66047f9f67af', '6e74df50-35a0-499c-951b-b4285cb0368b', 'adcb8840-27e2-4942-8064-77ca57c7bb4b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:01 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Created reservations ['541fe378-909d-45a7-8e4a-3aba6a9684ab', 'edbf4c8b-b4da-47cd-9e87-61da3b48d002', 'b8052f78-8499-4267-8389-02c9ef606441', '18b03b69-f09e-4e4f-9495-9310ea5c9055', 'b11ad0ec-2eb5-4e77-9813-a6d109547fc2'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:02 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:19:02 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Creating offline snapshot 68dad074-2059-4153-bb9e-508a48b89c11 of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:19:02 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.515s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-49ab74da-d8a7-432f-80c0-62f4b35e856a tempest-GroupsTest-1652101156 None] Delete group completed successfully.
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8effe40b-05e7-4d29-86ca-85c515a0a17b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:02 devstack sudo[95891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:19:02 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:03 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.561s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:03 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 1G
Sep 23 00:19:03 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:03 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 1G" returned: 0 in 0.658s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:03 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11
Sep 23 00:19:03 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:04 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11" returned: 0 in 0.556s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:04 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 is being set with open permissions: ugo+rw
Sep 23 00:19:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:04 devstack sudo[95921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11
Sep 23 00:19:04 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:04 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11" returned: 0 in 0.426s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a6cfa904-fee8-4c5d-853f-3fcc558beb76 tempest-SnapshotsActionsTest-328233182 None] Create snapshot completed successfully
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-68dad074-2059-4153-bb9e-508a48b89c11-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-68dad074-2059-4153-bb9e-508a48b89c11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Acquiring lock "cinder-quobyte-68dad074-2059-4153-bb9e-508a48b89c11" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-68dad074-2059-4153-bb9e-508a48b89c11" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Deleting offline snapshot 68dad074-2059-4153-bb9e-508a48b89c11 of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] snapshot_file for this snap is: volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a43699-ddb7-4de7-a8ce-504897435b2f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:06 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11
Sep 23 00:19:06 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:06 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11" returned: 0 in 0.613s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfab84-2a47-4b1b-8249-6dfbff327fc9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:06 devstack sudo[95929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:19:06 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:07 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.608s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:07 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11
Sep 23 00:19:07 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:08 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11" returned: 0 in 0.668s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:08 devstack sudo[95941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11
Sep 23 00:19:08 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:08 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.68dad074-2059-4153-bb9e-508a48b89c11" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-68dad074-2059-4153-bb9e-508a48b89c11" released by "_delete_snapshot" :: held 2.510s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" released by "delete_snapshot" :: held 2.548s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Created reservations ['97153775-c04e-47ff-b5f8-2faf7d6ae139', '38371d9c-b7f6-4ede-83ce-07ef5afa7a60', '797b9358-0fc6-4712-8541-262e8e9c2535', '1a9d88e1-fea4-461f-a23d-5fee30080605', 'c869a6f2-e271-44de-a2e5-8f2bfb7a43f2'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Delete snapshot completed successfully.
Sep 23 00:19:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-627c2be2-6563-42da-818b-4cb93e186501 tempest-SnapshotsActionsTest-459128687 None] Lock "cinder-68dad074-2059-4153-bb9e-508a48b89c11-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "cinder-ce453223-46e9-4939-a71e-b5e1326e495d-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-ce453223-46e9-4939-a71e-b5e1326e495d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "cinder-quobyte-ce453223-46e9-4939-a71e-b5e1326e495d" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-quobyte-ce453223-46e9-4939-a71e-b5e1326e495d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Deleting offline snapshot ce453223-46e9-4939-a71e-b5e1326e495d of volume a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] snapshot_file for this snap is: volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[42001127-fe8e-492e-9d4a-925b7ef9b45e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:10 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:19:10 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:10 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.690s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f118644c-b1ba-457c-9ab3-d7ac9cd680a1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:11 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5
Sep 23 00:19:11 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:11 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5" returned: 0 in 0.800s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:11 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:19:11 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:12 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.818s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:12 devstack sudo[96024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d
Sep 23 00:19:12 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:13 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5.ce453223-46e9-4939-a71e-b5e1326e495d" returned: 0 in 0.578s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-quobyte-ce453223-46e9-4939-a71e-b5e1326e495d" released by "_delete_snapshot" :: held 3.089s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" released by "delete_snapshot" :: held 3.131s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:13 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Created reservations ['6183fd16-4860-4eda-80a2-47b52a464b1b', '7d5564df-630b-4597-b7d0-ca293a2fcb9d', 'a4aab200-b8d6-40d6-b392-00b3234822f3', '533ae069-043a-4178-b2ee-002191a4db3a', 'f2a8a0b0-b2c2-46dd-b740-be1fd58b72fa'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Delete snapshot completed successfully.
Sep 23 00:19:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29f527fe-5833-4619-8a4d-780a52f3f506 tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-ce453223-46e9-4939-a71e-b5e1326e495d-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Flow 'volume_create_manager' (475fadfe-6cee-43f5-a113-63fe14b4b40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059993ef-4d0b-4ed5-9536-be6849760aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059993ef-4d0b-4ed5-9536-be6849760aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-243168943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad85bb37-1bd1-4a2a-89f3-0bae5eb90992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fd0946365e4cd6b2b9a15558505f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:14Z,use_quota=True,user_id='cd2077ce38e747b2b98f2f5dcf4f7874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c31558-927c-4581-a6f8-773e4099064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c31558-927c-4581-a6f8-773e4099064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ab35c5-cf4e-4f34-bafc-e2e9d490e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ab35c5-cf4e-4f34-bafc-e2e9d490e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad85bb37-1bd1-4a2a-89f3-0bae5eb90992', 'volume_name': 'volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dde28ef-c48e-49ec-8fa9-393c794326f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dde28ef-c48e-49ec-8fa9-393c794326f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ca7f66-7efd-489b-b6d3-6e64a221b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Volume ad85bb37-1bd1-4a2a-89f3-0bae5eb90992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992', 'volume_size': 1}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-243168943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad85bb37-1bd1-4a2a-89f3-0bae5eb90992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fd0946365e4cd6b2b9a15558505f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:14Z,use_quota=True,user_id='cd2077ce38e747b2b98f2f5dcf4f7874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Creating volume ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:14 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "cinder-a4b8cc21-d14f-46dc-80e0-16c005c646b5-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:14 devstack sudo[96030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 1073741824
Sep 23 00:19:14 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-a4b8cc21-d14f-46dc-80e0-16c005c646b5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec0cdf-740a-46b9-92a5-6ed1ed655f88]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:14 devstack sudo[96032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5
Sep 23 00:19:14 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:15 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 1073741824" returned: 0 in 0.694s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:15 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992
Sep 23 00:19:15 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:15 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5" returned: 0 in 0.642s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:15 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5
Sep 23 00:19:15 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:15 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" returned: 0 in 0.330s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ca7f66-7efd-489b-b6d3-6e64a221b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca5ac25-34d1-4451-bc14-d21e1b86e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Volume volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 (ad85bb37-1bd1-4a2a-89f3-0bae5eb90992): created successfully
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca5ac25-34d1-4451-bc14-d21e1b86e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Flow 'volume_create_manager' (475fadfe-6cee-43f5-a113-63fe14b4b40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-5ca5200b-4771-42ea-ae80-b92956e26701 req-39a607d0-0f2a-4495-a0f9-40c7416d4f1c tempest-VolumesSnapshotsTestJSON-1780904105 None] Created volume successfully.
Sep 23 00:19:15 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4b8cc21-d14f-46dc-80e0-16c005c646b5" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-quobyte-a4b8cc21-d14f-46dc-80e0-16c005c646b5" released by "delete_volume" :: held 1.120s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-a7f15a85-ca14-4a2b-9067-285898b372ba req-1ca09dee-69c8-47eb-b463-710cd6e2edf4 tempest-AttachVolumeShelveTestJSON-1819111500 None] No connector for attachment d2351158-3e1c-4e7d-b0c2-060f168725d6; skipping storage backend terminate_connection call. {{(pid=87293) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-a7f15a85-ca14-4a2b-9067-285898b372ba req-1ca09dee-69c8-47eb-b463-710cd6e2edf4 tempest-AttachVolumeShelveTestJSON-1819111500 None] Deleting attachment d2351158-3e1c-4e7d-b0c2-060f168725d6. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Created reservations ['72b48ee7-80d3-4029-b7f2-43401bf353ca', '441e60e2-ec01-48a4-8297-b7331d05f1be', '4e0e1ff9-c42c-4ec8-b112-a5d5d2488ac1', '5e5b85b3-fdac-4aba-879f-acb8483044bf', 'f0bc8eff-8982-4f9b-87d9-c3d6dbc47730'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:16 devstack sudo[96048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:19:16 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:16 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.409s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Deleted volume successfully.
Sep 23 00:19:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cff1fbab-a27f-4e34-bf70-9887571105cc tempest-SnapshotsActionsTest-328233182 None] Lock "cinder-a4b8cc21-d14f-46dc-80e0-16c005c646b5-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Creating offline snapshot f649c03f-ab58-4ebd-a7bd-b581119dfcc6 of volume ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb63134-a266-4e2f-9792-ac032ce09435]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:17 devstack sudo[96052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992
Sep 23 00:19:17 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:17 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" returned: 0 in 0.565s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:17 devstack sudo[96059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 1G
Sep 23 00:19:17 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:18 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 1G" returned: 0 in 0.731s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:18 devstack sudo[96066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6
Sep 23 00:19:18 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:18 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6" returned: 0 in 0.487s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:18 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 is being set with open permissions: ugo+rw
Sep 23 00:19:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:18 devstack sudo[96072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6
Sep 23 00:19:18 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:19 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6" returned: 0 in 0.309s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:19 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info
Sep 23 00:19:19 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:19 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info" returned: 0 in 0.315s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:19 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info is being set with open permissions: ugo+rw
Sep 23 00:19:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:19 devstack sudo[96078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info
Sep 23 00:19:19 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:19 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.info" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-65713494-856d-494b-b9f0-66b4e7333259 req-a18a81b6-0820-4e3e-bf0a-c7bcdbc544a1 tempest-VolumesSnapshotsTestJSON-1780904105 None] Create snapshot completed successfully
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "cinder-f649c03f-ab58-4ebd-a7bd-b581119dfcc6-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-f649c03f-ab58-4ebd-a7bd-b581119dfcc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "cinder-quobyte-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-quobyte-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "cinder-quobyte-f649c03f-ab58-4ebd-a7bd-b581119dfcc6" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-quobyte-f649c03f-ab58-4ebd-a7bd-b581119dfcc6" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Deleting offline snapshot f649c03f-ab58-4ebd-a7bd-b581119dfcc6 of volume ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] snapshot_file for this snap is: volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df1c9d-9c3d-4367-9c9c-c99e6d14ff31]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:21 devstack sudo[96083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6
Sep 23 00:19:21 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:21 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6" returned: 0 in 0.560s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:22 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb922d3-c53c-4b18-a32c-6c58897e116a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:22 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992
Sep 23 00:19:22 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:22 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" returned: 0 in 0.747s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:22 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6
Sep 23 00:19:22 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:23 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6" returned: 0 in 0.628s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:23 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6
Sep 23 00:19:23 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:23 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992.f649c03f-ab58-4ebd-a7bd-b581119dfcc6" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-quobyte-f649c03f-ab58-4ebd-a7bd-b581119dfcc6" released by "_delete_snapshot" :: held 2.529s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-quobyte-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" released by "delete_snapshot" :: held 2.582s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:24 devstack cinder-volume[87293]: DEBUG cinder.quota [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Created reservations ['4837a7ea-1ef4-43c3-b261-db98d6dd1103', 'e2626f4d-edf5-436c-bfef-53ece1e90429', '1ee56451-4661-4291-aa61-ac9bdaf5bc09', '8819a94f-d771-4e23-9cd7-0f64558ee925', '8031dbf6-5855-41a9-a5ec-5abafc34a8b3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:24 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Delete snapshot completed successfully.
Sep 23 00:19:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-818d9498-772e-42ea-a030-bb89f7595cb8 req-a3272eab-0368-4074-bb63-26eb88c1b41d tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-f649c03f-ab58-4ebd-a7bd-b581119dfcc6-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "cinder-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "cinder-quobyte-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-quobyte-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[be104b89-5d96-4878-9664-93eda5b3eee5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:25 devstack sudo[96101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992
Sep 23 00:19:25 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:25 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" returned: 0 in 0.699s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:25 devstack sudo[96121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992
Sep 23 00:19:25 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:26 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" returned: 0 in 0.458s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-quobyte-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992" released by "delete_volume" :: held 1.260s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG cinder.quota [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Created reservations ['25f6b77c-ea90-4b48-a0b3-34cdc76c0df5', '1422e96c-3bc9-42de-8fba-54c92e88f61d', '2a6b571c-1df0-4357-b8a6-c87cc022d593', '6926d580-a0b6-4f93-a09b-5f748a4f3882', '5ee03e92-4db6-40f2-9ffa-bdfe9427311e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:26 devstack sudo[96139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:19:26 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:27 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.679s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:27 devstack cinder-volume[87293]: DEBUG cinder.manager [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Deleted volume successfully.
Sep 23 00:19:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-0a2f3b64-9d1c-4741-a123-a347428675ce req-3beca1e3-3e81-4d5f-bf74-a9cf660a58bf tempest-VolumesSnapshotsTestJSON-1780904105 None] Lock "cinder-ad85bb37-1bd1-4a2a-89f3-0bae5eb90992-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:28 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=156,cinder:SELECT=136,cinder:DELETE=5,cinder:INSERT=37 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:19:28 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=151,cinder:UPDATE=152,cinder:INSERT=45,cinder:DELETE=13 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:19:28 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Flow 'volume_create_manager' (a7577f82-4ce2-47f6-8d7d-c2791b1237ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9561bc1-9e2b-4541-82db-1a2b1799341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9561bc1-9e2b-4541-82db-1a2b1799341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-537424657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52a6016-9fc8-40ef-b037-f19410efccad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266c8499b8c84ca2a21e121de6a4ea03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:29Z,use_quota=True,user_id='a78a2e4f7d6d49e5a7fa7229844b6a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35ae7f0-a37e-42ba-b16b-b050ca6076e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35ae7f0-a37e-42ba-b16b-b050ca6076e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed20b8d-c74a-499c-821a-a7325119cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed20b8d-c74a-499c-821a-a7325119cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52a6016-9fc8-40ef-b037-f19410efccad', 'volume_name': 'volume-e52a6016-9fc8-40ef-b037-f19410efccad', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806fcb21-909e-4ca2-87f7-5445ec2fc238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806fcb21-909e-4ca2-87f7-5445ec2fc238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6902a170-d55b-4298-a434-f55f8f6ef534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:29 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Volume e52a6016-9fc8-40ef-b037-f19410efccad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52a6016-9fc8-40ef-b037-f19410efccad', 'volume_size': 1}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-537424657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52a6016-9fc8-40ef-b037-f19410efccad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266c8499b8c84ca2a21e121de6a4ea03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:29Z,use_quota=True,user_id='a78a2e4f7d6d49e5a7fa7229844b6a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Creating volume e52a6016-9fc8-40ef-b037-f19410efccad {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:29 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:29 devstack sudo[96149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad 1073741824
Sep 23 00:19:29 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:29 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad 1073741824" returned: 0 in 0.907s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:30 devstack sudo[96190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad
Sep 23 00:19:30 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:30 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad" returned: 0 in 0.674s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6902a170-d55b-4298-a434-f55f8f6ef534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52a6016-9fc8-40ef-b037-f19410efccad', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2e9c85-f14c-4edb-a3bb-38da1d991025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Volume volume-e52a6016-9fc8-40ef-b037-f19410efccad (e52a6016-9fc8-40ef-b037-f19410efccad): created successfully
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2e9c85-f14c-4edb-a3bb-38da1d991025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Flow 'volume_create_manager' (a7577f82-4ce2-47f6-8d7d-c2791b1237ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ee2b437c-68ac-4069-ad77-fd2bf44f27f4 tempest-VolumesServicesTestJSON-1361932110 None] Created volume successfully.
Sep 23 00:19:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Acquiring lock "cinder-e52a6016-9fc8-40ef-b037-f19410efccad-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Lock "cinder-e52a6016-9fc8-40ef-b037-f19410efccad-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Acquiring lock "cinder-quobyte-e52a6016-9fc8-40ef-b037-f19410efccad" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Lock "cinder-quobyte-e52a6016-9fc8-40ef-b037-f19410efccad" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b3592f-5f8a-4ed4-afc5-71d32b69a9ae]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:32 devstack sudo[96227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad
Sep 23 00:19:32 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:32 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad" returned: 0 in 0.921s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:32 devstack sudo[96235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad
Sep 23 00:19:32 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:33 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e52a6016-9fc8-40ef-b037-f19410efccad" returned: 0 in 0.512s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Lock "cinder-quobyte-e52a6016-9fc8-40ef-b037-f19410efccad" released by "delete_volume" :: held 1.516s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Created reservations ['1130e2bd-522a-4e3f-952e-55dbeb4d6e7a', '6079c08b-3eac-4b11-8779-1cb6427964ff', '26f9fcaf-576f-45a5-a49c-2269c626c679', '5a4061fc-2dee-401c-af02-993198f5a0f6', 'e661fbde-7258-4f46-9b28-8f402468b823'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:33 devstack sudo[96239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:19:33 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:34 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.707s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:34 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Deleted volume successfully.
Sep 23 00:19:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b7a653c1-2acf-4849-9ed1-3cc1c70c8e10 tempest-VolumesServicesTestJSON-1361932110 None] Lock "cinder-e52a6016-9fc8-40ef-b037-f19410efccad-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c13936d5-880f-42cb-9427-44b5d1b23bf2 tempest-GroupSnapshotsTest-52878504 None] Group tempest-GroupSnapshotsTest-Group-1129339483: creating
Sep 23 00:19:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c13936d5-880f-42cb-9427-44b5d1b23bf2 tempest-GroupSnapshotsTest-52878504 None] Group tempest-GroupSnapshotsTest-Group-1129339483: created successfully
Sep 23 00:19:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c13936d5-880f-42cb-9427-44b5d1b23bf2 tempest-GroupSnapshotsTest-52878504 None] Create group completed successfully.
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:39 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:19:39 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:40 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.466s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:19:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:19:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (6b11adfe-b0f8-48eb-9270-90d235af76fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b67ce0-1583-464e-9d12-67383d0d8f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b67ce0-1583-464e-9d12-67383d0d8f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958810860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5d7e3c48-5cd2-46be-896e-db1c59b51553,host='devstack@QuobyteHD#QuobyteHD',id=91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:41Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b4d01cc-b98e-43fe-a9d0-bdb69d00532f),volume_type_id=6b4d01cc-b98e-43fe-a9d0-bdb69d00532f)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b85593a-539c-41ce-b38a-ec477899f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b85593a-539c-41ce-b38a-ec477899f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158af39b-b25c-4afe-aae3-03e95e223bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158af39b-b25c-4afe-aae3-03e95e223bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2', 'volume_name': 'volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932b8d54-78cd-40a3-b66b-7137e63b7127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932b8d54-78cd-40a3-b66b-7137e63b7127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a819b-4e41-48aa-8cf6-07bb151a4d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:41 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Volume 91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2', 'volume_size': 1}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5d7e3c48-5cd2-46be-896e-db1c59b51553,created_at=2026-09-22T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958810860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5d7e3c48-5cd2-46be-896e-db1c59b51553,host='devstack@QuobyteHD#QuobyteHD',id=91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:41Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b4d01cc-b98e-43fe-a9d0-bdb69d00532f),volume_type_id=6b4d01cc-b98e-43fe-a9d0-bdb69d00532f)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Creating volume 91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:41 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:19:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:41 devstack sudo[96259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 1073741824
Sep 23 00:19:41 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:42 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 1073741824" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:42 devstack sudo[96265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2
Sep 23 00:19:42 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:42 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" returned: 0 in 0.394s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a819b-4e41-48aa-8cf6-07bb151a4d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8c830c-3040-45bb-babd-4eb15db5bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Volume volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 (91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2): created successfully
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8c830c-3040-45bb-babd-4eb15db5bb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (6b11adfe-b0f8-48eb-9270-90d235af76fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-32a53319-bf24-4264-80d6-a16ef8aa9fa9 tempest-GroupSnapshotsTest-52878504 None] Created volume successfully.
Sep 23 00:19:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] GroupSnapshot 378a019d-419e-42fe-808c-30fd52f129d7: creating.
Sep 23 00:19:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Group snapshot 378a019d-419e-42fe-808c-30fd52f129d7: creating. {{(pid=87293) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:19:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Creating offline snapshot 8879d625-a578-4dd5-87c7-04e529471d12 of volume 91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:19:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b0f68-e960-4014-b06d-f5c37025b13e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:44 devstack sudo[96268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2
Sep 23 00:19:44 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:45 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" returned: 0 in 0.611s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:45 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 1G
Sep 23 00:19:45 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:46 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 1G" returned: 0 in 0.813s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:46 devstack sudo[96279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12
Sep 23 00:19:46 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:46 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12" returned: 0 in 0.445s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:46 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:19:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:46 devstack sudo[96284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12
Sep 23 00:19:46 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:46 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12" returned: 0 in 0.435s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:47 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info
Sep 23 00:19:47 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:47 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info" returned: 0 in 0.515s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:47 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:19:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:47 devstack sudo[96294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info
Sep 23 00:19:47 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:48 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.info" returned: 0 in 0.533s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.555s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-77b3e2f6-ea92-40cd-94cc-6b3d876c0c5d tempest-GroupSnapshotsTest-52878504 None] group_snapshot 378a019d-419e-42fe-808c-30fd52f129d7: created successfully
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-8879d625-a578-4dd5-87c7-04e529471d12-faa4968c-9418-4d3a-af56-ca0057ac77a3" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-8879d625-a578-4dd5-87c7-04e529471d12-faa4968c-9418-4d3a-af56-ca0057ac77a3" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Creating volume faa4968c-9418-4d3a-af56-ca0057ac77a3 from snapshot 8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-faa4968c-9418-4d3a-af56-ca0057ac77a3" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-faa4968c-9418-4d3a-af56-ca0057ac77a3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] snapshot: 8879d625-a578-4dd5-87c7-04e529471d12, volume: faa4968c-9418-4d3a-af56-ca0057ac77a3,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2c3c4-5736-47fc-b3e0-4b30daffb3d3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:50 devstack sudo[96297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12
Sep 23 00:19:50 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:51 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12" returned: 0 in 0.693s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c5fe4-c8dd-448f-ba6e-93965db70df8]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:51 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2
Sep 23 00:19:51 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:51 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" returned: 0 in 0.579s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:19:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:51 devstack sudo[96310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3
Sep 23 00:19:51 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:00 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:20:00 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=16,cinder:INSERT=5,cinder:SELECT=17,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Flow 'volume_create_manager' (87849ee2-1403-4840-8ec0-eff53569d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908f873c-1497-441c-a0a7-c177bad5ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908f873c-1497-441c-a0a7-c177bad5ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-846578652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1902b36-b4c0-4967-9fc8-e3b67f74ce44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef39c99d6248988abee2c74afe4884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:03Z,use_quota=True,user_id='5c91d692b427436382dd27eb31d714a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a393cad2-2e7a-4142-8fe2-88a771700894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a393cad2-2e7a-4142-8fe2-88a771700894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314f031f-308f-49a6-964a-6c2fff10857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314f031f-308f-49a6-964a-6c2fff10857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1902b36-b4c0-4967-9fc8-e3b67f74ce44', 'volume_name': 'volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569c575b-b859-48f0-9d94-58acc720a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:03 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569c575b-b859-48f0-9d94-58acc720a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f3cb64-524c-445b-84df-67df443804e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:03 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Volume e1902b36-b4c0-4967-9fc8-e3b67f74ce44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44', 'volume_size': 1}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3" returned: 0 in 11.667s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2, size 1024.00 MB, duration 11.67 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:20:03 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Converted 1024.00 MB image at 87.76 MB/s
Sep 23 00:20:03 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:03 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3
Sep 23 00:20:03 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:03 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3" returned: 0 in 0.314s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-faa4968c-9418-4d3a-af56-ca0057ac77a3" released by "_copy_volume_from_snapshot" :: held 13.401s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-8879d625-a578-4dd5-87c7-04e529471d12-faa4968c-9418-4d3a-af56-ca0057ac77a3" released by "_create_volume_from_snapshot" :: held 13.502s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.528s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-846578652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1902b36-b4c0-4967-9fc8-e3b67f74ce44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef39c99d6248988abee2c74afe4884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:03Z,use_quota=True,user_id='5c91d692b427436382dd27eb31d714a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Creating volume e1902b36-b4c0-4967-9fc8-e3b67f74ce44 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:03 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:03 devstack sudo[96356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 1073741824
Sep 23 00:20:03 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8c134dfc-0cf6-498f-97a8-8a1386fdda98 tempest-GroupSnapshotsTest-52878504 None] Create group from source-snapshot-378a019d-419e-42fe-808c-30fd52f129d7 completed successfully.
Sep 23 00:20:04 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 1073741824" returned: 0 in 0.817s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:04 devstack sudo[96363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44
Sep 23 00:20:04 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-faa4968c-9418-4d3a-af56-ca0057ac77a3" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-faa4968c-9418-4d3a-af56-ca0057ac77a3" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[62555f30-8fbe-4b47-b1b0-cb96dba8dfda]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:04 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44" returned: 0 in 0.316s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f3cb64-524c-445b-84df-67df443804e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a67498-54ff-4635-bb27-337db28490d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Volume volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 (e1902b36-b4c0-4967-9fc8-e3b67f74ce44): created successfully
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a67498-54ff-4635-bb27-337db28490d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Flow 'volume_create_manager' (87849ee2-1403-4840-8ec0-eff53569d81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7f850f24-aad4-465d-a866-865e9843a8d0 tempest-VolumeQuotasAdminTestJSON-1760937964 None] Created volume successfully.
Sep 23 00:20:05 devstack sudo[96365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3
Sep 23 00:20:05 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:05 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3" returned: 0 in 0.529s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:05 devstack sudo[96371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3
Sep 23 00:20:05 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:05 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-faa4968c-9418-4d3a-af56-ca0057ac77a3" returned: 0 in 0.308s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-faa4968c-9418-4d3a-af56-ca0057ac77a3" released by "delete_volume" :: held 0.890s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Created reservations ['21c259f0-4e4e-43e3-88e5-432566d12ea0'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:05 devstack cinder-volume[87293]: WARNING cinder.quota [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1164403914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1164403914, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:05 devstack cinder-volume[87293]: WARNING cinder.quota [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1164403914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1164403914, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:05 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Created reservations ['5764ba66-dbff-4beb-9d0c-57210679ee94', '13bdf89e-add4-4c7c-9120-fe50a57c1ce5', 'dac928ff-777d-4142-bab7-8710bb5a8f2f', 'b862b49f-39cc-4765-b854-f192bd88a1da', '3aeb005d-853b-4cdd-b023-28c10b9ca049'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:06 devstack sudo[96374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:06 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "cinder-e1902b36-b4c0-4967-9fc8-e3b67f74ce44-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "cinder-e1902b36-b4c0-4967-9fc8-e3b67f74ce44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "cinder-quobyte-e1902b36-b4c0-4967-9fc8-e3b67f74ce44" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "cinder-quobyte-e1902b36-b4c0-4967-9fc8-e3b67f74ce44" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde52f86-bd7e-433a-b486-1a05522f7585]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:06 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.477s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-55ba3969-74f3-4342-9331-eff1f4fc1ab9 tempest-GroupSnapshotsTest-52878504 None] Delete group completed successfully.
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Acquiring lock "cinder-d5f3d6a2-cd17-45ce-9c03-018aefd296c9-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "cinder-d5f3d6a2-cd17-45ce-9c03-018aefd296c9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:06 devstack sudo[96377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44
Sep 23 00:20:06 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Acquiring lock "cinder-quobyte-d5f3d6a2-cd17-45ce-9c03-018aefd296c9" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "cinder-quobyte-d5f3d6a2-cd17-45ce-9c03-018aefd296c9" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[90597952-6f48-4696-b601-f184e79df611]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:07 devstack sudo[96379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9
Sep 23 00:20:07 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:07 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44" returned: 0 in 0.513s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:07 devstack sudo[96384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44
Sep 23 00:20:07 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:07 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9" returned: 0 in 0.515s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:07 devstack sudo[96390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9
Sep 23 00:20:07 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:07 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] group_snapshot 378a019d-419e-42fe-808c-30fd52f129d7: deleting
Sep 23 00:20:07 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e1902b36-b4c0-4967-9fc8-e3b67f74ce44" returned: 0 in 0.357s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] group_snapshot 378a019d-419e-42fe-808c-30fd52f129d7: deleting {{(pid=87293) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "cinder-quobyte-e1902b36-b4c0-4967-9fc8-e3b67f74ce44" released by "delete_volume" :: held 0.945s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-8879d625-a578-4dd5-87c7-04e529471d12" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-8879d625-a578-4dd5-87c7-04e529471d12" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Deleting offline snapshot 8879d625-a578-4dd5-87c7-04e529471d12 of volume 91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] snapshot_file for this snap is: volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Created reservations ['fb4e68e5-8762-4284-9b2c-ad15ea2ced08', '56c55929-16bf-4125-a327-c4bb446fd3bc', '8399c274-6031-4de2-9a6c-97dc5276debd', '0513804a-1106-4362-9529-8d9ba96f762c', '61a688e7-6da8-4b80-bf15-d9301af80723'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa66164-cf6b-47b8-91de-b747d2fa3bb7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:07 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d5f3d6a2-cd17-45ce-9c03-018aefd296c9" returned: 0 in 0.523s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:07 devstack sudo[96395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:07 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "cinder-quobyte-d5f3d6a2-cd17-45ce-9c03-018aefd296c9" released by "delete_volume" :: held 1.100s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:08 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12
Sep 23 00:20:08 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Created reservations ['bd45744a-2508-47fa-ab11-56f04aad0ac2', '5d87a084-d300-4533-8fc3-2e79db51ee52', 'd2507fe5-6af6-45f0-b891-14262de7d3b6', '93c49b0d-70aa-4505-8f3a-e5dd21982a88', '2c69d2e3-0979-4b41-b322-a1e1c96ec1e0'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:08 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:08 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:08 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.437s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Deleted volume successfully.
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80a45bf2-00eb-4ca3-ad70-a179bb997dbf tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "cinder-e1902b36-b4c0-4967-9fc8-e3b67f74ce44-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:08 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12" returned: 0 in 0.735s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:20:08 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.355s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Deleted volume successfully.
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[701822cd-da9a-4150-9ec4-dec542f49cf2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1898943f-e583-4d5a-9fa3-ac2fb8f50e3c tempest-AttachVolumeShelveTestJSON-1819111500 None] Lock "cinder-d5f3d6a2-cd17-45ce-9c03-018aefd296c9-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:08 devstack sudo[96405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2
Sep 23 00:20:08 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:09 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" returned: 0 in 0.964s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:09 devstack sudo[96410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12
Sep 23 00:20:09 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Flow 'volume_create_manager' (abd2bb37-cc88-4bfd-a9a4-9571f187251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41025e4f-8e4d-4ed5-a3a0-593069b11e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41025e4f-8e4d-4ed5-a3a0-593069b11e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-197204478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef39c99d6248988abee2c74afe4884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:10Z,use_quota=True,user_id='5c91d692b427436382dd27eb31d714a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c7aeb7-02e8-4c58-be90-fdc84bbafc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c7aeb7-02e8-4c58-be90-fdc84bbafc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0c080c-fd6a-44f4-b79f-35d04248f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0c080c-fd6a-44f4-b79f-35d04248f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf', 'volume_name': 'volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785d1cbe-0051-4bff-a917-37f84cef8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785d1cbe-0051-4bff-a917-37f84cef8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6cb759-9655-478a-a81b-f58266b57dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:10 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Volume d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf', 'volume_size': 1}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-197204478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef39c99d6248988abee2c74afe4884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:10Z,use_quota=True,user_id='5c91d692b427436382dd27eb31d714a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Creating volume d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:10 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:10 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12" returned: 0 in 0.704s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:10 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12
Sep 23 00:20:10 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:10 devstack sudo[96416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf 1073741824
Sep 23 00:20:10 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:10 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2.8879d625-a578-4dd5-87c7-04e529471d12" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-8879d625-a578-4dd5-87c7-04e529471d12" released by "_delete_snapshot" :: held 2.970s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" released by "delete_snapshot" :: held 3.020s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:10 devstack cinder-volume[87293]: WARNING cinder.quota [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1164403914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1164403914, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] Created reservations ['2f23a87f-270a-4ae0-8574-1e4330b874d5', '99beea26-6abc-4e9e-915f-817d957f319d', '53129c7a-ac6c-4682-bbf2-a7475667befa', '4e5f3ac9-d9a2-4504-9fc9-d3e571078e4d', 'e9ef1451-5650-45d7-8420-f76cc3b5fc45'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:10 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf 1073741824" returned: 0 in 0.699s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:10 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f5996135-a51d-41ec-a004-b2be5b1ac09d tempest-GroupSnapshotsTest-52878504 None] group_snapshot 378a019d-419e-42fe-808c-30fd52f129d7: deleted successfully
Sep 23 00:20:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:10 devstack sudo[96426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf
Sep 23 00:20:10 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:11 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf" returned: 0 in 0.337s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6cb759-9655-478a-a81b-f58266b57dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe5efa6-8f93-45e0-b322-726a3a933b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:11 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Volume volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf (d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf): created successfully
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe5efa6-8f93-45e0-b322-726a3a933b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Flow 'volume_create_manager' (abd2bb37-cc88-4bfd-a9a4-9571f187251e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4b32fd98-4c6a-4527-9cc6-10becde9002e tempest-VolumeQuotasAdminTestJSON-1760937964 None] Created volume successfully.
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b57ad7-fa40-472d-9ba2-3337446a06eb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:11 devstack sudo[96429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2
Sep 23 00:20:11 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" returned: 0 in 0.624s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack sudo[96440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2
Sep 23 00:20:12 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" returned: 0 in 0.436s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-91bd77d3-1a4f-4d0d-8a82-fa50d7f170f2" released by "delete_volume" :: held 1.179s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Created reservations ['512c5fde-1cc9-4527-9e23-06d0d7f6e50a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:12 devstack cinder-volume[87293]: WARNING cinder.db.api [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1164403914']
Sep 23 00:20:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Created reservations ['8ef04008-659d-45fc-8b93-e85b8e940047', '456824fd-2e11-43af-bfad-344eb7a14767', '13ffa83e-66e8-40bf-bf19-3d71fdc70454', '543837d1-09bc-4a1a-b9cb-ae416f4b24a8', '32698323-5e8b-4196-9c6c-e8099a243c61'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:13 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:13 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:13 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.338s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:13 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e51a216a-945b-4716-a849-8adac15326ad tempest-GroupSnapshotsTest-52878504 None] Delete group completed successfully.
Sep 23 00:20:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b9504059-9c62-42b2-b072-bb9214d46c30 tempest-VolumeQuotasAdminTestJSON-1986994078 None] Transfer volume completed successfully.
Sep 23 00:20:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Acquiring lock "cinder-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Lock "cinder-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Acquiring lock "cinder-quobyte-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0a0b3ef3-4272-418b-96b3-7e8fcb357ff3 tempest-GroupSnapshotsTest-52878504 None] Group tempest-GroupSnapshotsTest-Group-1381316791: creating
Sep 23 00:20:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Lock "cinder-quobyte-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf" acquired by "delete_volume" :: waited 0.064s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764bf1e-c520-46c2-89e2-4b68df240dbc]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0a0b3ef3-4272-418b-96b3-7e8fcb357ff3 tempest-GroupSnapshotsTest-52878504 None] Group tempest-GroupSnapshotsTest-Group-1381316791: created successfully
Sep 23 00:20:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0a0b3ef3-4272-418b-96b3-7e8fcb357ff3 tempest-GroupSnapshotsTest-52878504 None] Create group completed successfully.
Sep 23 00:20:15 devstack sudo[96484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf
Sep 23 00:20:15 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:15 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf" returned: 0 in 0.456s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:15 devstack sudo[96489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf
Sep 23 00:20:15 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:15 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Lock "cinder-quobyte-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf" released by "delete_volume" :: held 0.863s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:15 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Created reservations ['5d6e7cde-d1fd-420c-bdc5-24cdeb9e23d5', '9eb8591d-c400-4b03-974b-547740866c6b', '0e650e87-15cd-4904-8605-511bce30abbf', '2b7f909d-3bcc-49a9-b807-6886ae0f73dd', 'ad8aeb71-1bd7-4507-8541-8162bba70fa4'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:16 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:16 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:16 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Deleted volume successfully.
Sep 23 00:20:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5994a8d1-2238-4a73-b8b7-d3fbd4c7b8b2 tempest-VolumeQuotasAdminTestJSON-165940452 None] Lock "cinder-d3c65b3c-d15c-4bfe-a3aa-f945a8a08dbf-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (383929d2-da24-4d12-9ede-5867f6b390b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc5f2df-2efa-4a70-8399-8a419cb4b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc5f2df-2efa-4a70-8399-8a419cb4b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-172414473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1fa2fc16-94b0-4fd5-98e3-dbad65f38ac0,host='devstack@QuobyteHD#QuobyteHD',id=df2a30ad-cb84-4c35-81f7-711a51a3c75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:17Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424dac7d-ab78-454d-a6d8-f25aac707132),volume_type_id=424dac7d-ab78-454d-a6d8-f25aac707132)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a0265d-30d4-45a1-a2ce-126ce8c2eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a0265d-30d4-45a1-a2ce-126ce8c2eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7421fc4c-4552-44e6-bbfb-dc62a703c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7421fc4c-4552-44e6-bbfb-dc62a703c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2a30ad-cb84-4c35-81f7-711a51a3c75e', 'volume_name': 'volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71fd88d-8856-49bc-949b-82dfc08e8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71fd88d-8856-49bc-949b-82dfc08e8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff919d9b-ead1-4888-b077-3a4962629364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:17 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Volume df2a30ad-cb84-4c35-81f7-711a51a3c75e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e', 'volume_size': 1}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1fa2fc16-94b0-4fd5-98e3-dbad65f38ac0,created_at=2026-09-22T22:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-172414473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1fa2fc16-94b0-4fd5-98e3-dbad65f38ac0,host='devstack@QuobyteHD#QuobyteHD',id=df2a30ad-cb84-4c35-81f7-711a51a3c75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:17Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424dac7d-ab78-454d-a6d8-f25aac707132),volume_type_id=424dac7d-ab78-454d-a6d8-f25aac707132)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Creating volume df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:17 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:17 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e 1073741824
Sep 23 00:20:17 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:17 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e 1073741824" returned: 0 in 0.662s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:17 devstack sudo[96502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e
Sep 23 00:20:17 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:18 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e" returned: 0 in 0.481s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff919d9b-ead1-4888-b077-3a4962629364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4d18ce-a0e3-4504-bea6-d4c549ad8c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:18 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Volume volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e (df2a30ad-cb84-4c35-81f7-711a51a3c75e): created successfully
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4d18ce-a0e3-4504-bea6-d4c549ad8c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (383929d2-da24-4d12-9ede-5867f6b390b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-83739f17-15c7-434d-8309-050309dd2365 tempest-GroupSnapshotsTest-52878504 None] Created volume successfully.
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (2fc3e272-ce3a-4a03-8bf5-73e3978b791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772ab3c1-00f5-42ef-883a-706b16840c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772ab3c1-00f5-42ef-883a-706b16840c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827116698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1fa2fc16-94b0-4fd5-98e3-dbad65f38ac0,host='devstack@QuobyteHD#QuobyteHD',id=bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:20Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424dac7d-ab78-454d-a6d8-f25aac707132),volume_type_id=424dac7d-ab78-454d-a6d8-f25aac707132)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbc0e2b-8902-478c-8eed-fff4ca95e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbc0e2b-8902-478c-8eed-fff4ca95e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf4d473-9a69-43f9-93ee-26a133e97cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf4d473-9a69-43f9-93ee-26a133e97cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6', 'volume_name': 'volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9120c7f3-c6d6-443a-b6ee-589d451e9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9120c7f3-c6d6-443a-b6ee-589d451e9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613cbc35-4471-4104-b84b-99fa3192e6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:20 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Volume bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6', 'volume_size': 1}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1fa2fc16-94b0-4fd5-98e3-dbad65f38ac0,created_at=2026-09-22T22:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827116698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1fa2fc16-94b0-4fd5-98e3-dbad65f38ac0,host='devstack@QuobyteHD#QuobyteHD',id=bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:20Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424dac7d-ab78-454d-a6d8-f25aac707132),volume_type_id=424dac7d-ab78-454d-a6d8-f25aac707132)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Creating volume bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:20 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:20 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 1073741824
Sep 23 00:20:20 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:21 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 1073741824" returned: 0 in 0.636s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:21 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6
Sep 23 00:20:21 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:21 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613cbc35-4471-4104-b84b-99fa3192e6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf855f1-6d1f-48a6-85dd-2ce2056e20cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:21 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Volume volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 (bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6): created successfully
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf855f1-6d1f-48a6-85dd-2ce2056e20cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (2fc3e272-ce3a-4a03-8bf5-73e3978b791e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9e857b8f-b1b3-4a30-b316-30f770f125f9 tempest-GroupSnapshotsTest-52878504 None] Created volume successfully.
Sep 23 00:20:23 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a1e831a1-7e37-4d24-95c2-1540bf61c237 tempest-GroupSnapshotsTest-52878504 None] Update group completed successfully.
Sep 23 00:20:24 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ba13249d-176f-45c1-994a-9be22cfe1325 tempest-GroupSnapshotsTest-52878504 None] Update group completed successfully.
Sep 23 00:20:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fb76f8df-8f63-44ae-b9f3-528467654df1 tempest-GroupSnapshotsTest-52878504 None] Update group completed successfully.
Sep 23 00:20:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4a35d511-ee23-44f7-8bcf-b33e9503d9c5 tempest-GroupSnapshotsTest-52878504 None] Update group completed successfully.
Sep 23 00:20:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] GroupSnapshot 8940d998-619c-4c50-8495-a1fa15afaec9: creating.
Sep 23 00:20:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Group snapshot 8940d998-619c-4c50-8495-a1fa15afaec9: creating. {{(pid=87293) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:20:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Creating offline snapshot c3c0e528-5db9-494b-98e9-32518025920f of volume df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:20:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e02d4b-e2f5-416c-a2f9-03dde90f47b3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:29 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e
Sep 23 00:20:29 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:30 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e" returned: 0 in 0.601s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:30 devstack sudo[96521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f 1G
Sep 23 00:20:30 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:30 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f 1G" returned: 0 in 0.740s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:31 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f
Sep 23 00:20:31 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:31 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f" returned: 0 in 0.436s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:31 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:31 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f
Sep 23 00:20:31 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:31 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:31 devstack sudo[96537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info
Sep 23 00:20:31 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:32 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info" returned: 0 in 0.481s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:32 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:32 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info
Sep 23 00:20:32 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:32 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.info" returned: 0 in 0.328s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Creating offline snapshot f20af964-e5ce-4cb2-bbf5-96c1432934bc of volume bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7be8b4-f1c9-47f2-82c7-d2bbe4bdc72b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:32 devstack sudo[96543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6
Sep 23 00:20:32 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-187d9796-82dc-41cb-8f8b-029dc14ad6ac tempest-GroupSnapshotsV319Test-423699151 None] Group tempest-GroupSnapshotsV319Test-Group-53537181: creating
Sep 23 00:20:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-187d9796-82dc-41cb-8f8b-029dc14ad6ac tempest-GroupSnapshotsV319Test-423699151 None] Group tempest-GroupSnapshotsV319Test-Group-53537181: created successfully
Sep 23 00:20:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-187d9796-82dc-41cb-8f8b-029dc14ad6ac tempest-GroupSnapshotsV319Test-423699151 None] Create group completed successfully.
Sep 23 00:20:33 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" returned: 0 in 0.652s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:33 devstack sudo[96552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc 1G
Sep 23 00:20:33 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:34 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc 1G" returned: 0 in 0.627s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:34 devstack sudo[96558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc
Sep 23 00:20:34 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:34 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc" returned: 0 in 0.511s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:34 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:34 devstack sudo[96565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc
Sep 23 00:20:34 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:34 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc" returned: 0 in 0.370s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:34 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info
Sep 23 00:20:34 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Flow 'volume_create_manager' (ba50365d-00d6-4e82-bbd3-d466387b04f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0846bf6f-521f-46c2-85c1-807dea7c87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:35 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info" returned: 0 in 0.535s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:35 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0846bf6f-521f-46c2-85c1-807dea7c87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1430177642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f6c6726-7964-4821-b1e6-0f244076e2ea,host='devstack@QuobyteHD#QuobyteHD',id=5ecd2b0c-57bb-4990-8d78-ceb5348431bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5214c43a18488d8c53a7a2b6173be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:35Z,use_quota=True,user_id='c3d509b291f14d798681ef3f107a668b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9e6e3c4-3928-4ef7-9ae0-4810868850b1),volume_type_id=f9e6e3c4-3928-4ef7-9ae0-4810868850b1)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90e6e58-7d12-482a-854e-ac620dbb18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:35 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info
Sep 23 00:20:35 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90e6e58-7d12-482a-854e-ac620dbb18e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc39476f-89cf-4724-8fca-92722a195a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc39476f-89cf-4724-8fca-92722a195a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecd2b0c-57bb-4990-8d78-ceb5348431bf', 'volume_name': 'volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87180e8a-af6d-4fd7-bdc1-303e763c6416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87180e8a-af6d-4fd7-bdc1-303e763c6416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8e4e47-d3a2-4753-b6da-61f5a2265b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Volume 5ecd2b0c-57bb-4990-8d78-ceb5348431bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf', 'volume_size': 1}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:35 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.info" returned: 0 in 0.318s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f6c6726-7964-4821-b1e6-0f244076e2ea,created_at=2026-09-22T22:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1430177642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f6c6726-7964-4821-b1e6-0f244076e2ea,host='devstack@QuobyteHD#QuobyteHD',id=5ecd2b0c-57bb-4990-8d78-ceb5348431bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5214c43a18488d8c53a7a2b6173be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:35Z,use_quota=True,user_id='c3d509b291f14d798681ef3f107a668b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9e6e3c4-3928-4ef7-9ae0-4810868850b1),volume_type_id=f9e6e3c4-3928-4ef7-9ae0-4810868850b1)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Creating volume 5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:35 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:35 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf 1073741824
Sep 23 00:20:35 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-01879b40-cb97-49c6-9bc8-adacfd7d3ce9 tempest-GroupSnapshotsTest-52878504 None] group_snapshot 8940d998-619c-4c50-8495-a1fa15afaec9: created successfully
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:36 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Flow 'volume_create_manager' (fb91e705-8bd3-45c6-a238-3fa296d7382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1c3762-63ae-4937-9bff-8d79664e52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf 1073741824" returned: 0 in 0.888s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1c3762-63ae-4937-9bff-8d79664e52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-570399067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb7e968-6220-4bed-8e16-f526f07a28a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ed5ac140574caa96d9c61b385245cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:37Z,use_quota=True,user_id='a76c49db5b1f4715be02d2a0f125610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f70d000f-95de-4d51-981b-bd22f0e264af),volume_type_id=f70d000f-95de-4d51-981b-bd22f0e264af)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941b70f1-ae8c-4c41-a1f1-840dbd80b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941b70f1-ae8c-4c41-a1f1-840dbd80b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab5014a-7626-472c-ada0-a01691658203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab5014a-7626-472c-ada0-a01691658203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb7e968-6220-4bed-8e16-f526f07a28a1', 'volume_name': 'volume-ceb7e968-6220-4bed-8e16-f526f07a28a1', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e251df3-0308-4311-bb56-fdfe756dee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e251df3-0308-4311-bb56-fdfe756dee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5cddbc-b293-4a08-844a-b0aa64758018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Volume ceb7e968-6220-4bed-8e16-f526f07a28a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb7e968-6220-4bed-8e16-f526f07a28a1', 'volume_size': 1}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] group_snapshot 8940d998-619c-4c50-8495-a1fa15afaec9: deleting
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] group_snapshot 8940d998-619c-4c50-8495-a1fa15afaec9: deleting {{(pid=87293) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-df2a30ad-cb84-4c35-81f7-711a51a3c75e" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:36 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf
Sep 23 00:20:36 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-df2a30ad-cb84-4c35-81f7-711a51a3c75e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-c3c0e528-5db9-494b-98e9-32518025920f" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-c3c0e528-5db9-494b-98e9-32518025920f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Deleting offline snapshot c3c0e528-5db9-494b-98e9-32518025920f of volume df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] snapshot_file for this snap is: volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c413db20-86a3-4918-b480-47d48b2a7671]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:37 devstack sudo[96595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f
Sep 23 00:20:37 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:37 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" returned: 0 in 0.505s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-570399067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb7e968-6220-4bed-8e16-f526f07a28a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ed5ac140574caa96d9c61b385245cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:37Z,use_quota=True,user_id='a76c49db5b1f4715be02d2a0f125610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f70d000f-95de-4d51-981b-bd22f0e264af),volume_type_id=f70d000f-95de-4d51-981b-bd22f0e264af)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Creating volume ceb7e968-6220-4bed-8e16-f526f07a28a1 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:37 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8e4e47-d3a2-4753-b6da-61f5a2265b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59264a72-8060-42b4-a0d1-09604411df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:37 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 1073741824
Sep 23 00:20:37 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Volume volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf (5ecd2b0c-57bb-4990-8d78-ceb5348431bf): created successfully
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59264a72-8060-42b4-a0d1-09604411df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Flow 'volume_create_manager' (ba50365d-00d6-4e82-bbd3-d466387b04f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:37 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-41caea99-5395-4a6f-8da4-f7d58344f7b3 tempest-GroupSnapshotsV319Test-423699151 None] Created volume successfully.
Sep 23 00:20:37 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f" returned: 0 in 0.647s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e65e9-2931-41aa-98d0-c5a108e4b025]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:37 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e
Sep 23 00:20:37 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:38 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 1073741824" returned: 0 in 0.710s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:38 devstack sudo[96614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1
Sep 23 00:20:38 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] GroupSnapshot b8d12d71-c276-4cd6-94ba-f7cd157534dd: creating.
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Group snapshot b8d12d71-c276-4cd6-94ba-f7cd157534dd: creating. {{(pid=87293) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:38 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e" returned: 0 in 0.620s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:38 devstack sudo[96619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f
Sep 23 00:20:38 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:38 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1" returned: 0 in 0.331s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.247s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Creating offline snapshot c8235c4c-52d2-4705-b254-3a87aa323d93 of volume 5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5cddbc-b293-4a08-844a-b0aa64758018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb7e968-6220-4bed-8e16-f526f07a28a1', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b1891a-ee92-4e78-8134-97a3cf368ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[708c06d8-a688-454c-9266-7bdeaa038705]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Volume volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 (ceb7e968-6220-4bed-8e16-f526f07a28a1): created successfully
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b1891a-ee92-4e78-8134-97a3cf368ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Flow 'volume_create_manager' (fb91e705-8bd3-45c6-a238-3fa296d7382f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-34e4c4f0-5e1c-43aa-a551-bc1a7856eb2f tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Created volume successfully.
Sep 23 00:20:38 devstack sudo[96623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf
Sep 23 00:20:38 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:38 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f" returned: 0 in 0.395s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:38 devstack sudo[96628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f
Sep 23 00:20:38 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:39 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:39 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e.c3c0e528-5db9-494b-98e9-32518025920f" returned: 0 in 0.322s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:39 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 1G
Sep 23 00:20:39 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-c3c0e528-5db9-494b-98e9-32518025920f" released by "_delete_snapshot" :: held 2.170s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-df2a30ad-cb84-4c35-81f7-711a51a3c75e" released by "delete_snapshot" :: held 2.219s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-f20af964-e5ce-4cb2-bbf5-96c1432934bc" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-f20af964-e5ce-4cb2-bbf5-96c1432934bc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Deleting offline snapshot f20af964-e5ce-4cb2-bbf5-96c1432934bc of volume bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] snapshot_file for this snap is: volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a19078-d1fe-49b0-85c8-0f65778ccc52]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:39 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc
Sep 23 00:20:39 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:39 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 1G" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:39 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93
Sep 23 00:20:39 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc" returned: 0 in 0.538s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:20:39 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823d30f-3a37-4d20-b731-17aa0c2d6977]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:40 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:40 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:40 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6
Sep 23 00:20:40 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:40 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93" returned: 0 in 0.752s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:40 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:40 devstack sudo[96699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93
Sep 23 00:20:40 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:40 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.721s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:41 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:41 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:41 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" returned: 0 in 1.177s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:41 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc
Sep 23 00:20:41 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:41 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93" returned: 0 in 0.886s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:41 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info
Sep 23 00:20:41 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:41 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.661s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-33d742c1-5ec6-49b2-a4ae-3827c3a5e3a3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Retype volume completed successfully.
Sep 23 00:20:41 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info" returned: 0 in 0.465s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:41 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:41 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc" returned: 0 in 0.727s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:41 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info
Sep 23 00:20:41 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:41 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc
Sep 23 00:20:41 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Acquiring lock "cinder-ceb7e968-6220-4bed-8e16-f526f07a28a1-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "cinder-ceb7e968-6220-4bed-8e16-f526f07a28a1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Acquiring lock "cinder-quobyte-ceb7e968-6220-4bed-8e16-f526f07a28a1" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "cinder-quobyte-ceb7e968-6220-4bed-8e16-f526f07a28a1" acquired by "delete_volume" :: waited 0.049s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:42 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.info" returned: 0 in 0.646s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5f0c2-4810-46f9-b332-4f9c5c56d3c0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:42 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6.f20af964-e5ce-4cb2-bbf5-96c1432934bc" returned: 0 in 0.852s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-f20af964-e5ce-4cb2-bbf5-96c1432934bc" released by "_delete_snapshot" :: held 3.594s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" released by "delete_snapshot" :: held 3.632s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e3c616e-2340-4872-9ed1-adcaf6fe7d03 tempest-GroupSnapshotsV319Test-423699151 None] group_snapshot b8d12d71-c276-4cd6-94ba-f7cd157534dd: created successfully
Sep 23 00:20:42 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1
Sep 23 00:20:42 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:42 devstack cinder-volume[87293]: WARNING cinder.quota [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-984540922 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-984540922, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:42 devstack cinder-volume[87293]: WARNING cinder.quota [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-984540922 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-984540922, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:42 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Created reservations ['13714433-8581-4132-a177-3148c4629379', 'efc7cf02-713b-49f5-9805-e2e4d44b03c1', 'd411462f-2a8d-4d08-9471-198218cdfa0b', 'e106e74b-8bfe-431b-9dee-cdc9766e4de1', '81614bbb-8ac5-4d09-a03c-37a920f91684'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] Created reservations ['5eee7c51-e46a-4b7f-9214-56c6596459aa', '87eb440e-c9f8-4fed-a203-d3130f3e08af', '4d3f3c44-52bc-44b9-b8b9-64f853efb547', 'bbff5ccc-a706-4f49-8148-226d347fcbde', 'f545dc45-975d-46c7-8918-12573f6612d9'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:43 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1" returned: 0 in 0.763s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dad0f2ed-ace0-4b8a-b7bd-05ff5bda1cfa tempest-GroupSnapshotsTest-52878504 None] group_snapshot 8940d998-619c-4c50-8495-a1fa15afaec9: deleted successfully
Sep 23 00:20:43 devstack sudo[96760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1
Sep 23 00:20:43 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:43 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ceb7e968-6220-4bed-8e16-f526f07a28a1" returned: 0 in 0.275s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "cinder-quobyte-ceb7e968-6220-4bed-8e16-f526f07a28a1" released by "delete_volume" :: held 1.164s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:43 devstack cinder-volume[87293]: WARNING cinder.quota [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:43 devstack cinder-volume[87293]: WARNING cinder.quota [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Created reservations ['610985e0-8a57-4964-8419-24dadbb30741', 'e9117a7d-bfc9-4ea0-a10a-4987bc75c4e2', 'dec8009a-d0f7-4ded-815a-355893f6cd21', '998279c3-0d8b-462a-9fa2-24cc1ee9eb9c', '701f6e74-7d4f-4e14-ade0-aebb78d16364'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:43 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:43 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:44 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.438s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Deleted volume successfully.
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf0ad983-e36d-458d-bf45-01af28842dc3 tempest-VolumeRetypeWithoutMigrationTest-922565637 None] Lock "cinder-ceb7e968-6220-4bed-8e16-f526f07a28a1-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[59921b8f-442e-44a6-99fc-ffc5bfec9415]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:44 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6
Sep 23 00:20:44 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] group_snapshot b8d12d71-c276-4cd6-94ba-f7cd157534dd: deleting
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] group_snapshot b8d12d71-c276-4cd6-94ba-f7cd157534dd: deleting {{(pid=87293) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "cinder-quobyte-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "cinder-quobyte-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "cinder-quobyte-c8235c4c-52d2-4705-b254-3a87aa323d93" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "cinder-quobyte-c8235c4c-52d2-4705-b254-3a87aa323d93" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Deleting offline snapshot c8235c4c-52d2-4705-b254-3a87aa323d93 of volume 5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] snapshot_file for this snap is: volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31eb9b2-b973-4e32-a51b-b7e289a75bb4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:45 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93
Sep 23 00:20:45 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:45 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (4d77d452-f5b7-4360-856d-e64dc49efb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b022f876-5bf6-4114-911b-c8e574a7d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" returned: 0 in 1.001s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:45 devstack sudo[96773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6
Sep 23 00:20:45 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b022f876-5bf6-4114-911b-c8e574a7d977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-151705303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae74850-d1f5-447c-bab9-dcfe22288c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:45Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1ab71f-f4e7-4285-8e73-074e9f4bd63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1ab71f-f4e7-4285-8e73-074e9f4bd63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc6fd8-796f-4b47-8505-8817c0418553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc6fd8-796f-4b47-8505-8817c0418553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae74850-d1f5-447c-bab9-dcfe22288c0b', 'volume_name': 'volume-eae74850-d1f5-447c-bab9-dcfe22288c0b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d83d28-8bbf-4def-ad01-c847547accb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d83d28-8bbf-4def-ad01-c847547accb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e279bb-5344-41b9-b2db-aac047bc0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:45 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Volume eae74850-d1f5-447c-bab9-dcfe22288c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae74850-d1f5-447c-bab9-dcfe22288c0b', 'volume_size': 1}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-151705303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae74850-d1f5-447c-bab9-dcfe22288c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:45Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Creating volume eae74850-d1f5-447c-bab9-dcfe22288c0b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:45 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:45 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b 1073741824
Sep 23 00:20:45 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:45 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93" returned: 0 in 0.765s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[643df585-076e-4e05-a3dc-114e078c23f4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:46 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" returned: 0 in 0.454s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-bc2dd091-2d8e-49e7-9885-6b1bde4cdfb6" released by "delete_volume" :: held 1.573s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-df2a30ad-cb84-4c35-81f7-711a51a3c75e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-df2a30ad-cb84-4c35-81f7-711a51a3c75e" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:46 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf
Sep 23 00:20:46 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[22367b0f-26c4-457d-855d-57f7c93d18f1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:46 devstack sudo[96786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e
Sep 23 00:20:46 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:46 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" returned: 0 in 0.683s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:46 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b 1073741824" returned: 0 in 0.843s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:46 devstack sudo[96793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93
Sep 23 00:20:46 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:46 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b
Sep 23 00:20:46 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:46 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e" returned: 0 in 0.629s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:46 devstack sudo[96800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e
Sep 23 00:20:46 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:47 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:47 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b" returned: 0 in 0.518s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:47 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df2a30ad-cb84-4c35-81f7-711a51a3c75e" returned: 0 in 0.367s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93" returned: 0 in 0.630s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-df2a30ad-cb84-4c35-81f7-711a51a3c75e" released by "delete_volume" :: held 1.115s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:47 devstack sudo[96807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93
Sep 23 00:20:47 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e279bb-5344-41b9-b2db-aac047bc0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae74850-d1f5-447c-bab9-dcfe22288c0b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674d5e15-ce40-4e4f-a0e0-dbe695888ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:47 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Volume volume-eae74850-d1f5-447c-bab9-dcfe22288c0b (eae74850-d1f5-447c-bab9-dcfe22288c0b): created successfully
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674d5e15-ce40-4e4f-a0e0-dbe695888ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (4d77d452-f5b7-4360-856d-e64dc49efb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2ffcfc48-cff6-4c5c-94c2-1fc3199c449d tempest-VolumesActionsTest-154052190 None] Created volume successfully.
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Created reservations ['ccb10802-914d-4aba-9e87-6baf5e9adcff'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:47 devstack cinder-volume[87293]: WARNING cinder.quota [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-984540922 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-984540922, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Created reservations ['1fdc77a5-dd8e-4637-b4b6-35138b1aca4f', '2977a0a5-ed14-4dbc-bc57-364dac677a0f', 'a1a13b97-47be-4050-9d3d-00c18c663ef2', 'a77744fa-0d18-405c-80ee-f94fc852f48a', '9e50687b-e321-4a0a-bc97-f069e6035faa'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:47 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf.c8235c4c-52d2-4705-b254-3a87aa323d93" returned: 0 in 0.479s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a2ce8972-9710-4487-afa7-260ccbefc230 tempest-VolumesActionsTest-154052190 None] Acquiring lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b" by "attach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "cinder-quobyte-c8235c4c-52d2-4705-b254-3a87aa323d93" released by "_delete_snapshot" :: held 2.780s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Lock "cinder-quobyte-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" released by "delete_snapshot" :: held 2.862s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a2ce8972-9710-4487-afa7-260ccbefc230 tempest-VolumesActionsTest-154052190 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b" acquired by "attach_volume" :: waited 0.062s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Created reservations ['19fb8766-8458-409c-8894-d6577049c530', '65e7e241-53c4-4716-8243-07267b393b95', '40845b54-4a0b-47e2-87c8-48c357698505', 'aad37711-a3fc-47d8-a780-daacb00a8995', 'a43e6fd1-ff5a-469a-ade9-249bee96596f'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:48 devstack cinder-volume[87293]: WARNING cinder.quota [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1762214031 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1762214031, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:48 devstack cinder-volume[87293]: WARNING cinder.quota [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1762214031 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1762214031, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a2ce8972-9710-4487-afa7-260ccbefc230 tempest-VolumesActionsTest-154052190 None] Attaching volume eae74850-d1f5-447c-bab9-dcfe22288c0b to instance f1eb3e48-46bc-40ae-8a71-177e4659487f at mountpoint /dev/vdb on host None.
Sep 23 00:20:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a2ce8972-9710-4487-afa7-260ccbefc230 tempest-VolumesActionsTest-154052190 None] Attach volume completed successfully.
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] Created reservations ['c135587e-1702-4810-b53c-bd53ad7ecd14', 'eb0d168e-e59a-400b-9653-a91ef8630ea4', '7a82ba4d-2329-44fc-babb-5c6ea0d90d0f', 'cfa397b1-658c-4433-8156-8a904077db1c', '89b8be5c-d09d-49c2-921d-158d361938a5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a2ce8972-9710-4487-afa7-260ccbefc230 tempest-VolumesActionsTest-154052190 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b" released by "attach_volume" :: held 0.393s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:48 devstack sudo[96811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:48 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bba3cfc1-011f-4fff-9487-2df08c1787e3 tempest-GroupSnapshotsV319Test-423699151 None] group_snapshot b8d12d71-c276-4cd6-94ba-f7cd157534dd: deleted successfully
Sep 23 00:20:48 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8c61ffbe-bb31-405b-ae20-4fbebca8f326 tempest-GroupSnapshotsTest-52878504 None] Delete group completed successfully.
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "cinder-quobyte-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Lock "cinder-quobyte-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" acquired by "delete_volume" :: waited 0.050s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c601c4-3d14-4401-8604-a95b42adb6b6]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:49 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf
Sep 23 00:20:49 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dc447042-fcf0-41a7-ad09-36d0b2289157 tempest-VolumesActionsTest-28194877 None] Terminate volume connection completed successfully.
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dc447042-fcf0-41a7-ad09-36d0b2289157 tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-detach_volume" by "detach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dc447042-fcf0-41a7-ad09-36d0b2289157 tempest-VolumesActionsTest-28194877 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dc447042-fcf0-41a7-ad09-36d0b2289157 tempest-VolumesActionsTest-28194877 None] Detaching volume eae74850-d1f5-447c-bab9-dcfe22288c0b from instance f1eb3e48-46bc-40ae-8a71-177e4659487f.
Sep 23 00:20:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dc447042-fcf0-41a7-ad09-36d0b2289157 tempest-VolumesActionsTest-28194877 None] Detach volume completed successfully.
Sep 23 00:20:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dc447042-fcf0-41a7-ad09-36d0b2289157 tempest-VolumesActionsTest-28194877 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-detach_volume" released by "detach_volume" :: held 0.184s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:50 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" returned: 0 in 0.916s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:50 devstack sudo[96819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf
Sep 23 00:20:50 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-30f6036d-96f8-483c-9433-b28de4aed517 tempest-VolumesActionsTest-154052190 None] Acquiring lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-detach_volume" by "detach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-30f6036d-96f8-483c-9433-b28de4aed517 tempest-VolumesActionsTest-154052190 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-30f6036d-96f8-483c-9433-b28de4aed517 tempest-VolumesActionsTest-154052190 None] Volume detach called, but volume not attached.
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-30f6036d-96f8-483c-9433-b28de4aed517 tempest-VolumesActionsTest-154052190 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e7384e2-a2a2-4037-804b-6eb2ea0c8f91 tempest-GroupSnapshotsTest-52878504 None] Group tempest-GroupSnapshotsTest-Group-363576256: creating
Sep 23 00:20:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e7384e2-a2a2-4037-804b-6eb2ea0c8f91 tempest-GroupSnapshotsTest-52878504 None] Group tempest-GroupSnapshotsTest-Group-363576256: created successfully
Sep 23 00:20:50 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" returned: 0 in 0.453s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e7384e2-a2a2-4037-804b-6eb2ea0c8f91 tempest-GroupSnapshotsTest-52878504 None] Create group completed successfully.
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Lock "cinder-quobyte-5ecd2b0c-57bb-4990-8d78-ceb5348431bf" released by "delete_volume" :: held 1.476s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Created reservations ['465f1b70-8bec-4de3-95d4-f225255a6e48'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Acquiring lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:50 devstack cinder-volume[87293]: WARNING cinder.quota [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1762214031 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1762214031, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Created reservations ['6f3f161e-d719-481c-b7bd-b5f4835bde9f', '1ca781a9-c431-4c63-9648-d7426b69e1c9', 'd7e40407-045a-4434-bd2a-89906bec635c', 'ff59596b-19d0-41b6-87d2-e32ecee133df', '99f7a19b-75fa-423e-9960-ab0783eed92d'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Acquiring lock "cinder-quobyte-eae74850-d1f5-447c-bab9-dcfe22288c0b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Lock "cinder-quobyte-eae74850-d1f5-447c-bab9-dcfe22288c0b" acquired by "delete_volume" :: waited 0.058s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62af6c-35f1-4ab6-a2f0-c5d2c07dc87b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:51 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b
Sep 23 00:20:51 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:51 devstack sudo[96824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:51 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:51 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.500s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3e41697d-29a8-4936-b641-7f6710c92b4d tempest-GroupSnapshotsV319Test-423699151 None] Delete group completed successfully.
Sep 23 00:20:51 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b" returned: 0 in 0.772s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:51 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b
Sep 23 00:20:51 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:52 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-eae74850-d1f5-447c-bab9-dcfe22288c0b" returned: 0 in 0.438s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Lock "cinder-quobyte-eae74850-d1f5-447c-bab9-dcfe22288c0b" released by "delete_volume" :: held 1.314s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Created reservations ['e928994c-5728-4003-87f8-6bddb7dfd240', '8b709b68-fb0b-473e-b3c6-9845f157f1ad', '501772d2-fae3-4dc9-8dbd-3cf9da59b84b', '4008c048-4aed-4c6a-ad4f-59a3d2de8eb0', 'b7893807-ab2a-4089-875c-939644ceaebc'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:52 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:20:52 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (99d56bd7-1781-425a-bc4d-d47f1972f689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1c88e8-514a-4c1f-b7f9-cb65d031a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1c88e8-514a-4c1f-b7f9-cb65d031a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2079193089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2e5e552d-829a-47ea-9a03-36897cab8a45,host='devstack@QuobyteHD#QuobyteHD',id=cb4c5a43-aa1b-4dd8-a06d-be409a22158b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:53Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12bcfd0f-632f-43f1-a920-3d7ca18459c5),volume_type_id=12bcfd0f-632f-43f1-a920-3d7ca18459c5)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c980a1a0-401b-484e-aece-3374379bd79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c980a1a0-401b-484e-aece-3374379bd79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:53 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fecd27b-7e84-4a76-9823-500f3d32476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fecd27b-7e84-4a76-9823-500f3d32476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4c5a43-aa1b-4dd8-a06d-be409a22158b', 'volume_name': 'volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b1f2dd-3192-4bc1-8a0b-b57b6f30ee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b1f2dd-3192-4bc1-8a0b-b57b6f30ee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16f06d9-84f3-4e75-824d-cbab8d9779e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:53 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Volume cb4c5a43-aa1b-4dd8-a06d-be409a22158b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b', 'volume_size': 1}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2e5e552d-829a-47ea-9a03-36897cab8a45,created_at=2026-09-22T22:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2079193089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2e5e552d-829a-47ea-9a03-36897cab8a45,host='devstack@QuobyteHD#QuobyteHD',id=cb4c5a43-aa1b-4dd8-a06d-be409a22158b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217bd0f1b8e142cb9806129563895dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:53Z,use_quota=True,user_id='26d3acafa9cd4ab5b0d4f408e3edbe1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12bcfd0f-632f-43f1-a920-3d7ca18459c5),volume_type_id=12bcfd0f-632f-43f1-a920-3d7ca18459c5)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Creating volume cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:53 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.678s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Deleted volume successfully.
Sep 23 00:20:53 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b 1073741824
Sep 23 00:20:53 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87d55e96-7775-4b2f-840a-76ccfcba06c2 tempest-VolumesActionsTest-154052190 None] Lock "cinder-eae74850-d1f5-447c-bab9-dcfe22288c0b-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:54 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b 1073741824" returned: 0 in 1.116s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:54 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b
Sep 23 00:20:54 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:54 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" returned: 0 in 0.461s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16f06d9-84f3-4e75-824d-cbab8d9779e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01460263-b13e-481c-bd21-208cdde4b8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:55 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Volume volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b (cb4c5a43-aa1b-4dd8-a06d-be409a22158b): created successfully
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01460263-b13e-481c-bd21-208cdde4b8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Flow 'volume_create_manager' (99d56bd7-1781-425a-bc4d-d47f1972f689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-255cceb6-8e89-471e-90f7-5f7b9ae6566f tempest-GroupSnapshotsTest-52878504 None] Created volume successfully.
Sep 23 00:20:56 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] GroupSnapshot 0cb5bcfe-884d-4f27-abe9-9cf8bf03cbe8: creating.
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Group snapshot 0cb5bcfe-884d-4f27-abe9-9cf8bf03cbe8: creating. {{(pid=87293) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Creating offline snapshot 5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 of volume cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f3e7e4-1c30-4725-8aa1-1e8727257305]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:56 devstack sudo[96871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b
Sep 23 00:20:56 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:56 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:57 devstack sudo[96877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 1G
Sep 23 00:20:57 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:57 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 1G" returned: 0 in 0.698s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:57 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65
Sep 23 00:20:57 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:58 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (6fe640a5-4cff-4561-8aa8-bbf1f99fab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25801505-6022-4ae7-9c95-37d1a2c06f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" returned: 0 in 0.544s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:58 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:58 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65
Sep 23 00:20:58 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25801505-6022-4ae7-9c95-37d1a2c06f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-335475458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a567795-d4bd-4dad-998d-07b3086c3c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1242c0be-7588-470c-b94a-ec7d750688a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1242c0be-7588-470c-b94a-ec7d750688a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a328ba1a-0ae7-4434-b942-889cb937f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a328ba1a-0ae7-4434-b942-889cb937f066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a567795-d4bd-4dad-998d-07b3086c3c70', 'volume_name': 'volume-9a567795-d4bd-4dad-998d-07b3086c3c70', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09882cdf-725e-4724-95af-9a10f460d124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09882cdf-725e-4724-95af-9a10f460d124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9909d6d3-a2bd-41a0-93a3-689b8db731f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Volume 9a567795-d4bd-4dad-998d-07b3086c3c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a567795-d4bd-4dad-998d-07b3086c3c70', 'volume_size': 1}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Flow 'volume_create_manager' (651b6ee2-47d7-4fae-bc6f-b531d972376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aea68f5-2758-4ce7-8360-a6b3662f3b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aea68f5-2758-4ce7-8360-a6b3662f3b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-788335013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5268718-0136-4d6d-80a5-a3ffdeeede8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5505f6e0318140fc9c837d578fc09709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='ed9bf4813ea543a79bc26433ec9ae353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b13f01d-c94b-4d95-9388-91fba494f9bd),volume_type_id=4b13f01d-c94b-4d95-9388-91fba494f9bd)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46f769f-531a-4927-93e6-b16b1e4f3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46f769f-531a-4927-93e6-b16b1e4f3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965a3e62-e7fe-4c7f-ba7b-6a7a7004b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965a3e62-e7fe-4c7f-ba7b-6a7a7004b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5268718-0136-4d6d-80a5-a3ffdeeede8a', 'volume_name': 'volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b32400-fa1f-4b91-ba00-660261fef3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b32400-fa1f-4b91-ba00-660261fef3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff91f10-1e9b-4394-a860-1e41718b5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Volume b5268718-0136-4d6d-80a5-a3ffdeeede8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a', 'volume_size': 1}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:58 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:58 devstack sudo[96894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info
Sep 23 00:20:58 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:58 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info" returned: 0 in 0.284s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:58 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:58 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info
Sep 23 00:20:58 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:59 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.info" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.922s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-335475458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a567795-d4bd-4dad-998d-07b3086c3c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Creating volume 9a567795-d4bd-4dad-998d-07b3086c3c70 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:59 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:59 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70 1073741824
Sep 23 00:20:59 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d5d7718b-be17-499e-a636-7b0bfd7d7565 tempest-GroupSnapshotsTest-52878504 None] group_snapshot 0cb5bcfe-884d-4f27-abe9-9cf8bf03cbe8: created successfully
Sep 23 00:20:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] group_snapshot 0cb5bcfe-884d-4f27-abe9-9cf8bf03cbe8: deleting
Sep 23 00:20:59 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] group_snapshot 0cb5bcfe-884d-4f27-abe9-9cf8bf03cbe8: deleting {{(pid=87293) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70 1073741824" returned: 0 in 0.595s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Deleting offline snapshot 5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 of volume cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:21:00 devstack sudo[96905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70
Sep 23 00:21:00 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] snapshot_file for this snap is: volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dace0d-ab73-4c51-9e1b-dc82421ac5aa]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:00 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65
Sep 23 00:21:00 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:00 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70" returned: 0 in 0.406s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-788335013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5268718-0136-4d6d-80a5-a3ffdeeede8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5505f6e0318140fc9c837d578fc09709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='ed9bf4813ea543a79bc26433ec9ae353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b13f01d-c94b-4d95-9388-91fba494f9bd),volume_type_id=4b13f01d-c94b-4d95-9388-91fba494f9bd)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Creating volume b5268718-0136-4d6d-80a5-a3ffdeeede8a {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:00 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=171,cinder:UPDATE=184,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9909d6d3-a2bd-41a0-93a3-689b8db731f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a567795-d4bd-4dad-998d-07b3086c3c70', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce54d2c-3156-48a2-ba52-c5bc9b2aa47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=178,cinder:SELECT=177,cinder:INSERT=50,cinder:DELETE=5 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:00 devstack sudo[96910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a 1073741824
Sep 23 00:21:00 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Volume volume-9a567795-d4bd-4dad-998d-07b3086c3c70 (9a567795-d4bd-4dad-998d-07b3086c3c70): created successfully
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce54d2c-3156-48a2-ba52-c5bc9b2aa47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (6fe640a5-4cff-4561-8aa8-bbf1f99fab01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8ed47654-8d46-41f4-b7db-2d09ab45f155 tempest-VolumesActionsTest-154052190 None] Created volume successfully.
Sep 23 00:21:00 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" returned: 0 in 0.523s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcef4ab-159a-454c-be3b-a151225e2fe5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:00 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b
Sep 23 00:21:00 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:01 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a 1073741824" returned: 0 in 0.711s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:01 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:01 devstack sudo[96925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65
Sep 23 00:21:01 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:01 devstack sudo[96927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a
Sep 23 00:21:01 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-9a567795-d4bd-4dad-998d-07b3086c3c70-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Lock "cinder-9a567795-d4bd-4dad-998d-07b3086c3c70-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-quobyte-9a567795-d4bd-4dad-998d-07b3086c3c70" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-9a567795-d4bd-4dad-998d-07b3086c3c70" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:01 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a" returned: 0 in 0.495s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff91f10-1e9b-4394-a860-1e41718b5024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd81def2-c879-408a-8ee3-38ab3c2e4f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:01 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dfbfac-c321-4966-b604-af14c58e9695]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" returned: 0 in 0.595s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:01 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Volume volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a (b5268718-0136-4d6d-80a5-a3ffdeeede8a): created successfully
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd81def2-c879-408a-8ee3-38ab3c2e4f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Flow 'volume_create_manager' (651b6ee2-47d7-4fae-bc6f-b531d972376e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:01 devstack sudo[96935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65
Sep 23 00:21:01 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d5f9885c-1b9e-4823-b722-ec3b803c24ec tempest-VolumeTypesAccessTest-108130025 None] Created volume successfully.
Sep 23 00:21:01 devstack sudo[96934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70
Sep 23 00:21:01 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:02 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b.5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-5c84cf34-6c49-4f0a-9adc-c67ef03e5f65" released by "_delete_snapshot" :: held 2.222s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" released by "delete_snapshot" :: held 2.263s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:02 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70" returned: 0 in 0.508s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:02 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70
Sep 23 00:21:02 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:02 devstack cinder-volume[87293]: WARNING cinder.quota [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-281706801 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-281706801, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:21:02 devstack cinder-volume[87293]: WARNING cinder.quota [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-281706801 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-281706801, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] Created reservations ['3372cfed-a3b6-426c-84ac-14ac7076a35d', '9f008b1b-0905-4a7d-b304-ce068dc4735d', 'c7dba24c-79cd-47b0-9d23-7d2a15de306d', '8a08cd21-414d-4c25-9071-0440bfe72007', '3c7e48b3-4cdc-43a7-9196-51211323d624'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-21375061-992a-4004-bfb3-725ce9dadc05 tempest-GroupSnapshotsTest-52878504 None] group_snapshot 0cb5bcfe-884d-4f27-abe9-9cf8bf03cbe8: deleted successfully
Sep 23 00:21:02 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9a567795-d4bd-4dad-998d-07b3086c3c70" returned: 0 in 0.371s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-9a567795-d4bd-4dad-998d-07b3086c3c70" released by "delete_volume" :: held 0.965s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Created reservations ['18b9d596-a5c5-43cd-821d-f0d448cf820e', '9ef0a28d-d4f8-453b-937b-087bcc1e5d53', '6d528cd0-f4ca-4366-8bed-18cd45d609c0', 'e287cafb-69b6-4684-8924-30a586ee9022', '613f5032-19ff-4ebe-9898-b666de45bc73'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:02 devstack sudo[96946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:02 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Acquiring lock "cinder-b5268718-0136-4d6d-80a5-a3ffdeeede8a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Lock "cinder-b5268718-0136-4d6d-80a5-a3ffdeeede8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Acquiring lock "cinder-quobyte-b5268718-0136-4d6d-80a5-a3ffdeeede8a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Lock "cinder-quobyte-b5268718-0136-4d6d-80a5-a3ffdeeede8a" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e1dc4d-ccd4-4ab7-a3b9-15d64b610cc7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:03 devstack sudo[96948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a
Sep 23 00:21:03 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:03 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.354s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Deleted volume successfully.
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b418243e-6262-4961-adcb-a4d2bfef50ee tempest-VolumesActionsTest-28194877 None] Lock "cinder-9a567795-d4bd-4dad-998d-07b3086c3c70-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:03 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a" returned: 0 in 0.509s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:03 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a
Sep 23 00:21:03 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "cinder-quobyte-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[285821cf-390e-4066-bcc6-be279c18ecc9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:03 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b5268718-0136-4d6d-80a5-a3ffdeeede8a" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Lock "cinder-quobyte-b5268718-0136-4d6d-80a5-a3ffdeeede8a" released by "delete_volume" :: held 0.965s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:04 devstack cinder-volume[87293]: WARNING cinder.quota [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-404784483 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-404784483, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:21:04 devstack cinder-volume[87293]: WARNING cinder.quota [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-404784483 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-404784483, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:21:04 devstack sudo[96957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b
Sep 23 00:21:04 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Created reservations ['8b03c41b-98df-4afb-b5c2-f457a2c99a9d', 'be6aedf8-7cf8-429e-93da-a57dd3b18b2c', '62488dc6-43b6-4400-b4b3-95ac5ebcfa4f', '2099a8f0-f19e-43f6-b695-e845cc07ff25', '49ee93da-3a42-4132-9813-bf3c49c68a8a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:04 devstack sudo[96959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:04 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:04 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" returned: 0 in 0.664s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:04 devstack sudo[96964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b
Sep 23 00:21:04 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:04 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.350s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Deleted volume successfully.
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bebc4234-9416-4a5a-9b2a-335240d2feac tempest-VolumeTypesAccessTest-108130025 None] Lock "cinder-b5268718-0136-4d6d-80a5-a3ffdeeede8a-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:04 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" returned: 0 in 0.378s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Lock "cinder-quobyte-cb4c5a43-aa1b-4dd8-a06d-be409a22158b" released by "delete_volume" :: held 1.194s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (ec620f9b-71a6-4188-8482-d6f0b301e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9e9f12-8660-4f65-8e56-6d4ad8db5386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9e9f12-8660-4f65-8e56-6d4ad8db5386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813697770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f02ec2-6dab-4a2a-894a-6b91299b8a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:05Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b5ce20-8f77-4055-a9c2-6cf8c98bd05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b5ce20-8f77-4055-a9c2-6cf8c98bd05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d88929-c1c7-4c26-a24a-fab83bc29ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d88929-c1c7-4c26-a24a-fab83bc29ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f02ec2-6dab-4a2a-894a-6b91299b8a60', 'volume_name': 'volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a3f156-5224-4a04-8c53-7ebb44246739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a3f156-5224-4a04-8c53-7ebb44246739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5a52b0-1ed4-455b-9592-0e8540c8369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Volume 31f02ec2-6dab-4a2a-894a-6b91299b8a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60', 'volume_size': 1}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813697770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f02ec2-6dab-4a2a-894a-6b91299b8a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:05Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Creating volume 31f02ec2-6dab-4a2a-894a-6b91299b8a60 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:05 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:05 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 1073741824
Sep 23 00:21:05 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Created reservations ['580acddd-3645-43f9-a177-fcdfc3ab4088'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:05 devstack cinder-volume[87293]: WARNING cinder.quota [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-281706801 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-281706801, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Created reservations ['5a0f3a84-73cd-4ceb-ab37-227cab20af5a', '54e7e382-7ee5-4c2a-9f75-3b4e9382ba61', '79230a66-0902-450e-84ca-3ac258717f49', '9ff644d5-e62e-43df-8ee7-de544457efa5', '9732496e-ba18-419a-b7f6-dc2e4a7f6af3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:05 devstack sudo[96973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:05 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:05 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 1073741824" returned: 0 in 0.689s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:05 devstack sudo[96977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60
Sep 23 00:21:05 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:06 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b253e5cc-9e0e-46a0-a7c4-07c1de69837b tempest-GroupSnapshotsTest-52878504 None] Delete group completed successfully.
Sep 23 00:21:06 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60" returned: 0 in 0.362s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5a52b0-1ed4-455b-9592-0e8540c8369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b5a36-01b6-47b5-a751-59d2a4d11f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:06 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Volume volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 (31f02ec2-6dab-4a2a-894a-6b91299b8a60): created successfully
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b5a36-01b6-47b5-a751-59d2a4d11f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (ec620f9b-71a6-4188-8482-d6f0b301e187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-59f1fe1c-cbc7-4ba5-afd5-3702b607203c tempest-VolumesActionsTest-154052190 None] Created volume successfully.
Sep 23 00:21:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-31f02ec2-6dab-4a2a-894a-6b91299b8a60-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Lock "cinder-31f02ec2-6dab-4a2a-894a-6b91299b8a60-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-quobyte-31f02ec2-6dab-4a2a-894a-6b91299b8a60" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-31f02ec2-6dab-4a2a-894a-6b91299b8a60" acquired by "delete_volume" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df99d85-400c-48ce-8aa4-c5742c634459]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:07 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60
Sep 23 00:21:07 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:08 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60" returned: 0 in 0.471s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:08 devstack sudo[96986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60
Sep 23 00:21:08 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:08 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-31f02ec2-6dab-4a2a-894a-6b91299b8a60" returned: 0 in 0.358s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-31f02ec2-6dab-4a2a-894a-6b91299b8a60" released by "delete_volume" :: held 0.902s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Created reservations ['51fbd125-c998-462a-bd7d-26789c386bff', '3a4b5bff-c1f0-4388-bc06-4745f30178cf', '3c30dfd4-a1db-4101-a9a4-92d456940014', '5705d9aa-44c2-4932-b5ad-8b4a78c9d424', 'ec49568e-e7b9-454e-a20e-c00fa09c38bc'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:08 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:08 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:09 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.357s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:09 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Deleted volume successfully.
Sep 23 00:21:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-979cc99b-f162-440f-9d86-9cb3582f58e0 tempest-VolumesActionsTest-28194877 None] Lock "cinder-31f02ec2-6dab-4a2a-894a-6b91299b8a60-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (08fcecf5-ec49-4c09-9e38-1d7482be689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401b4308-df43-4655-b1da-1f76ba16985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401b4308-df43-4655-b1da-1f76ba16985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2029300260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496b0442-9042-45a3-bd61-11545c01154b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:10Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcf7f6c-c167-4fc2-993d-1ce8a4bb0ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcf7f6c-c167-4fc2-993d-1ce8a4bb0ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f756e1f9-80c3-40be-82c3-a226789a0200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f756e1f9-80c3-40be-82c3-a226789a0200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496b0442-9042-45a3-bd61-11545c01154b', 'volume_name': 'volume-496b0442-9042-45a3-bd61-11545c01154b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77782a9-5fd2-4287-9855-5a531452e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77782a9-5fd2-4287-9855-5a531452e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a41c09d-1f52-4fb9-8bf3-6a732ac8b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:10 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Volume 496b0442-9042-45a3-bd61-11545c01154b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496b0442-9042-45a3-bd61-11545c01154b', 'volume_size': 1}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2029300260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496b0442-9042-45a3-bd61-11545c01154b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:10Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Creating volume 496b0442-9042-45a3-bd61-11545c01154b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:10 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:10 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b 1073741824
Sep 23 00:21:10 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:11 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b 1073741824" returned: 0 in 0.745s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:11 devstack sudo[96999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b
Sep 23 00:21:11 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:11 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b" returned: 0 in 0.406s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a41c09d-1f52-4fb9-8bf3-6a732ac8b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496b0442-9042-45a3-bd61-11545c01154b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29e3b7f-0251-42e3-865e-9d388c8b1216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:11 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Volume volume-496b0442-9042-45a3-bd61-11545c01154b (496b0442-9042-45a3-bd61-11545c01154b): created successfully
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29e3b7f-0251-42e3-865e-9d388c8b1216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (08fcecf5-ec49-4c09-9e38-1d7482be689f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-40099731-b756-4b55-83c8-7bbacc518d55 tempest-VolumesActionsTest-154052190 None] Created volume successfully.
Sep 23 00:21:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-496b0442-9042-45a3-bd61-11545c01154b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Lock "cinder-496b0442-9042-45a3-bd61-11545c01154b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-quobyte-496b0442-9042-45a3-bd61-11545c01154b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-496b0442-9042-45a3-bd61-11545c01154b" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f1722-dbf8-48d6-be7c-185d4a370f6c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:13 devstack sudo[97008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b
Sep 23 00:21:13 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:13 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b" returned: 0 in 0.551s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:13 devstack sudo[97013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b
Sep 23 00:21:13 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:13 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-496b0442-9042-45a3-bd61-11545c01154b" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-496b0442-9042-45a3-bd61-11545c01154b" released by "delete_volume" :: held 0.962s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Created reservations ['15faab6c-83ba-4fc1-a372-a2e5dac870db', '3a16d117-f929-4a12-ab0e-7ae6bfdc4338', '178f0041-6da8-465f-be51-834387e7b561', '499a7f4d-27b9-4240-9471-23c726a62d3a', '7e6abee0-40fa-4bc1-806d-0d1610f9063f'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:14 devstack sudo[97016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:14 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:14 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Deleted volume successfully.
Sep 23 00:21:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ef35aec-19d1-4f1b-a9fc-e2f0149507ff tempest-VolumesActionsTest-28194877 None] Lock "cinder-496b0442-9042-45a3-bd61-11545c01154b-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (ee2fd58a-197b-42b8-a40b-cae76d21d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f9e99b-cb24-465f-b437-a04210484079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f9e99b-cb24-465f-b437-a04210484079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1447087065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed6c6d7-7507-42d6-b81e-60bb45aca760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:16Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514cba47-ba3d-43de-923b-7c755a572660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514cba47-ba3d-43de-923b-7c755a572660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc6f18a-edc4-455e-a62c-b93c60e3c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc6f18a-edc4-455e-a62c-b93c60e3c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed6c6d7-7507-42d6-b81e-60bb45aca760', 'volume_name': 'volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89f4dc3-ac44-4390-ba68-b61b859aee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89f4dc3-ac44-4390-ba68-b61b859aee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf8d165-2af1-482b-83ab-255d3bb1ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:16 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Volume 1ed6c6d7-7507-42d6-b81e-60bb45aca760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760', 'volume_size': 1}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1447087065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed6c6d7-7507-42d6-b81e-60bb45aca760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:16Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Creating volume 1ed6c6d7-7507-42d6-b81e-60bb45aca760 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:16 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:16 devstack sudo[97055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 1073741824
Sep 23 00:21:16 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dbd1e58c-04ab-481a-b349-4727f8733ae3 tempest-GroupsV320Test-537675106 None] Group tempest-GroupsV320Test-Group-1668858724: creating
Sep 23 00:21:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dbd1e58c-04ab-481a-b349-4727f8733ae3 tempest-GroupsV320Test-537675106 None] Group tempest-GroupsV320Test-Group-1668858724: created successfully
Sep 23 00:21:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dbd1e58c-04ab-481a-b349-4727f8733ae3 tempest-GroupsV320Test-537675106 None] Create group completed successfully.
Sep 23 00:21:17 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 1073741824" returned: 0 in 0.831s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:17 devstack sudo[97061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760
Sep 23 00:21:17 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:17 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760" returned: 0 in 0.340s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf8d165-2af1-482b-83ab-255d3bb1ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafcae28-8fca-411a-9a35-aa8fb7766082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:17 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Volume volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 (1ed6c6d7-7507-42d6-b81e-60bb45aca760): created successfully
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafcae28-8fca-411a-9a35-aa8fb7766082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (ee2fd58a-197b-42b8-a40b-cae76d21d274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9766b9f3-ad05-4f76-8a37-f1b657858e03 tempest-VolumesActionsTest-154052190 None] Created volume successfully.
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-1ed6c6d7-7507-42d6-b81e-60bb45aca760-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Lock "cinder-1ed6c6d7-7507-42d6-b81e-60bb45aca760-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Acquiring lock "cinder-quobyte-1ed6c6d7-7507-42d6-b81e-60bb45aca760" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-1ed6c6d7-7507-42d6-b81e-60bb45aca760" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a34b5f2-6576-47a0-8c3b-71940948537b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Created reservations ['f10d48d2-2483-47aa-9358-5a7013b14e5f'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:18 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:18 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:18 devstack sudo[97064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760
Sep 23 00:21:18 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:19 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.434s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-46fe1183-afd9-439b-9a4a-496272e7fc8e tempest-GroupsV320Test-537675106 None] Delete group completed successfully.
Sep 23 00:21:19 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760" returned: 0 in 0.630s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:19 devstack sudo[97073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760
Sep 23 00:21:19 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:19 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ed6c6d7-7507-42d6-b81e-60bb45aca760" returned: 0 in 0.348s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Lock "cinder-quobyte-1ed6c6d7-7507-42d6-b81e-60bb45aca760" released by "delete_volume" :: held 1.070s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:19 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Created reservations ['249369db-e132-4765-a0b9-a4d08a6f4969', '6efb73b1-2691-4408-b2b9-550b49e5846b', '3387cd63-5e00-46b8-8209-81976289c674', 'a0b0408c-4a5e-4a0e-8d7d-60608a69c983', 'f5c6e7e8-fa84-450a-acf2-74600911b8e1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:20 devstack sudo[97076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:20 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:20 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.327s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Deleted volume successfully.
Sep 23 00:21:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-38f8b666-5de1-4f41-a374-1a4247ecbd5d tempest-VolumesActionsTest-28194877 None] Lock "cinder-1ed6c6d7-7507-42d6-b81e-60bb45aca760-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (372e9013-4f49-4ab4-800b-9462664741ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e04f5-1bbc-4a6d-a29c-9e0149eb960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e04f5-1bbc-4a6d-a29c-9e0149eb960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-870760803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf85d00-b6a5-4ced-ae9d-14100b62f9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:21Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274c3a30-7077-42bc-9aea-cbe96d0623ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274c3a30-7077-42bc-9aea-cbe96d0623ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bc15ca-3e30-4306-9b8e-330afc3c421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bc15ca-3e30-4306-9b8e-330afc3c421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf85d00-b6a5-4ced-ae9d-14100b62f9b4', 'volume_name': 'volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf094d05-2b02-448c-86d8-482dbff5b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf094d05-2b02-448c-86d8-482dbff5b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c276626-732e-4174-a6f0-266e21463833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:21 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Volume cdf85d00-b6a5-4ced-ae9d-14100b62f9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4', 'volume_size': 1}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-870760803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf85d00-b6a5-4ced-ae9d-14100b62f9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cd012cdc8a4796855481e9de44df12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:21Z,use_quota=True,user_id='5124f9dcde0648ffb476533d122ee0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Creating volume cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:21 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:21 devstack sudo[97080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 1073741824
Sep 23 00:21:21 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:22 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 1073741824" returned: 0 in 0.767s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:22 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4
Sep 23 00:21:22 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:22 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4" returned: 0 in 0.435s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c276626-732e-4174-a6f0-266e21463833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d304e72-2eb5-4f6c-a750-c883b1f6f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:23 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Volume volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 (cdf85d00-b6a5-4ced-ae9d-14100b62f9b4): created successfully
Sep 23 00:21:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d304e72-2eb5-4f6c-a750-c883b1f6f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Flow 'volume_create_manager' (372e9013-4f49-4ab4-800b-9462664741ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:23 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4a4d55da-bf98-4ed8-a986-9296dbccb1cd tempest-VolumesActionsTest-154052190 None] Created volume successfully.
Sep 23 00:21:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Acquiring lock "cinder-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Lock "cinder-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Acquiring lock "cinder-quobyte-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Lock "cinder-quobyte-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:24 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8244d-ba7b-4479-b670-bf89770bb2b3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:24 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4
Sep 23 00:21:24 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:25 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4" returned: 0 in 0.563s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:25 devstack sudo[97093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4
Sep 23 00:21:25 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:25 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4" returned: 0 in 0.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Lock "cinder-quobyte-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4" released by "delete_volume" :: held 1.056s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Created reservations ['88eaa4eb-fe2e-4eb8-9387-5e4e20efde85', 'a5266e4e-63a1-4d4e-9d37-2e5d9393110a', '1199a9ce-4bb4-4f0f-97c0-c48bcd0e487f', '9b2c3876-9cf2-44e2-ad96-48c3e968a0c7', 'ee88b061-9198-4ab7-a3e3-879fdc43c909'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:26 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:26 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:26 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:26 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Deleted volume successfully.
Sep 23 00:21:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f452b08-e63b-4f2b-86cb-eae6bd01d65b tempest-VolumesActionsTest-154052190 None] Lock "cinder-cdf85d00-b6a5-4ced-ae9d-14100b62f9b4-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:35 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=95,cinder:DELETE=3,cinder:SELECT=75,cinder:INSERT=25 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:36 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=88,cinder:SELECT=59,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:36 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Flow 'volume_create_manager' (24819710-8320-4332-affc-f4e12872bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5533fd47-5498-4c56-8e39-feebfd4a4c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5533fd47-5498-4c56-8e39-feebfd4a4c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-647304841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9078cdef-cd11-434d-ad3c-54187ce4fcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='837ae3f92be4494a851ef74aba2f0770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:37Z,use_quota=True,user_id='f9354d85a6af43f080b0ccb573408016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c42c94a-0ef3-4a7f-aa15-eb798ccb2181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c42c94a-0ef3-4a7f-aa15-eb798ccb2181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710f3b1a-7c14-409e-89af-5c99277f131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:37 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710f3b1a-7c14-409e-89af-5c99277f131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9078cdef-cd11-434d-ad3c-54187ce4fcf0', 'volume_name': 'volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf169280>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecedd413-65f5-4948-9a2f-793553c9bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecedd413-65f5-4948-9a2f-793553c9bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5045d15e-555d-46ed-8b44-436752ae69ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Volume 9078cdef-cd11-434d-ad3c-54187ce4fcf0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf169280>}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Trying to clone 9078cdef-cd11-434d-ad3c-54187ce4fcf0 from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:21:38 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2f80a-355d-4851-92d0-e33336492458]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:38 devstack sudo[97106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD
Sep 23 00:21:38 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:39 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c is fetched for user f9354d85a6af43f080b0ccb573408016. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e075ac-5a75-4202-80be-8637b8225e3b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:39 devstack sudo[97111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD
Sep 23 00:21:39 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:39 devstack sudo[97116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:39 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:40 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD" returned: 0 in 0.633s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-647304841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9078cdef-cd11-434d-ad3c-54187ce4fcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='837ae3f92be4494a851ef74aba2f0770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:37Z,use_quota=True,user_id='f9354d85a6af43f080b0ccb573408016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Creating volume 9078cdef-cd11-434d-ad3c-54187ce4fcf0 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:40 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:40 devstack sudo[97118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 1073741824
Sep 23 00:21:40 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:40 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.423s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:21:40 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 1073741824" returned: 0 in 0.794s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:40 devstack sudo[97127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0
Sep 23 00:21:40 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:41 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0" returned: 0 in 0.394s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Attempting download of d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 9078cdef-cd11-434d-ad3c-54187ce4fcf0. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ddc37-312c-4bbe-9787-77cd56520128]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:41 devstack sudo[97130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk
Sep 23 00:21:41 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:41 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk" returned: 0 in 0.454s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:42 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk
Sep 23 00:21:42 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:42 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk" returned: 1 in 0.421s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_1hwaecqk' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f18bf-34d5-480a-91d2-6fb0edb4a45e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:42 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD
Sep 23 00:21:42 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:42 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] d3316061-b3c0-4b6e-8b31-c56fbf284d8c was qcow2, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:21:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:42 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0
Sep 23 00:21:42 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:45 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0" returned: 0 in 2.838s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:45 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_0zvztehbdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:21:45 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Converted 112.00 MB image at 39.44 MB/s
Sep 23 00:21:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:45 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 1G
Sep 23 00:21:45 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:46 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 1G" returned: 0 in 0.553s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Downloaded image d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 9078cdef-cd11-434d-ad3c-54187ce4fcf0 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c for user f9354d85a6af43f080b0ccb573408016 is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Marking volume 9078cdef-cd11-434d-ad3c-54187ce4fcf0 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Flow 'volume_create_manager' (60371eb8-c126-41e5-a751-9adc43689207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aebaa88-4fc3-4ff1-b3eb-2d718b4a3d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Copying metadata from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c to 9078cdef-cd11-434d-ad3c-54187ce4fcf0. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Creating volume glance metadata for volume 9078cdef-cd11-434d-ad3c-54187ce4fcf0 backed by image d3316061-b3c0-4b6e-8b31-c56fbf284d8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aebaa88-4fc3-4ff1-b3eb-2d718b4a3d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1849984860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9640c5-548f-437b-a166-4239a38ae45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729c06273a404e9bba01c4621a76493e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:46Z,use_quota=True,user_id='35b5d97f97cd4b078bdc54498f2d9d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d4a145-de0c-4c18-b373-e34d08a24c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d4a145-de0c-4c18-b373-e34d08a24c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5a1433-2c75-4dc2-9f50-4ac87d7c86fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5a1433-2c75-4dc2-9f50-4ac87d7c86fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9640c5-548f-437b-a166-4239a38ae45b', 'volume_name': 'volume-db9640c5-548f-437b-a166-4239a38ae45b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676b37de-b363-42fb-9287-d19d8da0cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676b37de-b363-42fb-9287-d19d8da0cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04019bc2-9d65-4199-b1cc-7f9f0af9db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:46 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Volume db9640c5-548f-437b-a166-4239a38ae45b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9640c5-548f-437b-a166-4239a38ae45b', 'volume_size': 1}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1849984860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9640c5-548f-437b-a166-4239a38ae45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729c06273a404e9bba01c4621a76493e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:46Z,use_quota=True,user_id='35b5d97f97cd4b078bdc54498f2d9d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Creating volume db9640c5-548f-437b-a166-4239a38ae45b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:46 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:46 devstack sudo[97157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b 1073741824
Sep 23 00:21:46 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5045d15e-555d-46ed-8b44-436752ae69ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf169280>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b0990-2d0b-4724-90c2-2be037609c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:46 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Volume volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 (9078cdef-cd11-434d-ad3c-54187ce4fcf0): created successfully
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b0990-2d0b-4724-90c2-2be037609c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Flow 'volume_create_manager' (24819710-8320-4332-affc-f4e12872bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c4e93564-0913-482f-b239-e36dfe74b41a tempest-VolumesImageMetadata-1178175563 None] Created volume successfully.
Sep 23 00:21:47 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b 1073741824" returned: 0 in 0.695s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:47 devstack sudo[97163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b
Sep 23 00:21:47 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:47 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b" returned: 0 in 0.356s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04019bc2-9d65-4199-b1cc-7f9f0af9db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9640c5-548f-437b-a166-4239a38ae45b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bd6bf4-b619-4846-b838-57cf0144d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:47 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Volume volume-db9640c5-548f-437b-a166-4239a38ae45b (db9640c5-548f-437b-a166-4239a38ae45b): created successfully
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bd6bf4-b619-4846-b838-57cf0144d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Flow 'volume_create_manager' (60371eb8-c126-41e5-a751-9adc43689207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f16435b9-0019-4b5a-b168-37bb870d4a97 tempest-VolumeQuotasNegativeTestJSON-408934019 None] Created volume successfully.
Sep 23 00:21:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Acquiring lock "cinder-9078cdef-cd11-434d-ad3c-54187ce4fcf0-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Lock "cinder-9078cdef-cd11-434d-ad3c-54187ce4fcf0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Acquiring lock "cinder-quobyte-9078cdef-cd11-434d-ad3c-54187ce4fcf0" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Lock "cinder-quobyte-9078cdef-cd11-434d-ad3c-54187ce4fcf0" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:48 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8563f47e-3665-4951-913c-72179dd6f614]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:48 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0
Sep 23 00:21:48 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:49 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0" returned: 0 in 0.648s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:49 devstack sudo[97171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0
Sep 23 00:21:49 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:49 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9078cdef-cd11-434d-ad3c-54187ce4fcf0" returned: 0 in 0.496s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Lock "cinder-quobyte-9078cdef-cd11-434d-ad3c-54187ce4fcf0" released by "delete_volume" :: held 1.247s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Created reservations ['a58eddfd-4828-4fff-b5dc-8e9051c6c749', '1097fed7-e0b8-4f84-b97d-988b56d321d5', '29ed81d9-0acb-41d4-bce5-9c2497d55fc9', '6fdfc6e9-a671-4c14-877d-611dfbd6be9d', '620f348f-21bf-47b4-ba00-33f088ad21ad'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:49 devstack sudo[97174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:49 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Flow 'volume_create_manager' (3913cd2c-fe1c-4f2f-877e-eae1d4b06838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63890c50-da37-4a5d-976b-7d18d8c03d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Acquiring lock "cinder-db9640c5-548f-437b-a166-4239a38ae45b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:50 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63890c50-da37-4a5d-976b-7d18d8c03d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-418622492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1ae2a8-01cc-4f82-8813-b13895458b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c807dcc40c24445e94570ef89433e820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:50Z,use_quota=True,user_id='7f8da9c0657a4f7fa48dd4faa7c88c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfc777c-b01e-4c6a-bd3c-bb5d9a5b1919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfc777c-b01e-4c6a-bd3c-bb5d9a5b1919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051e9393-2a4d-45b2-b17e-675222e9db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051e9393-2a4d-45b2-b17e-675222e9db72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca1ae2a8-01cc-4f82-8813-b13895458b90', 'volume_name': 'volume-ca1ae2a8-01cc-4f82-8813-b13895458b90', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5171f2f4-5ae2-4dd6-8320-e13a7f98a141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5171f2f4-5ae2-4dd6-8320-e13a7f98a141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a628e7a-bdc9-48ec-b3ab-ab37730d9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:50 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Volume ca1ae2a8-01cc-4f82-8813-b13895458b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca1ae2a8-01cc-4f82-8813-b13895458b90', 'volume_size': 1}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-418622492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1ae2a8-01cc-4f82-8813-b13895458b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c807dcc40c24445e94570ef89433e820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:50Z,use_quota=True,user_id='7f8da9c0657a4f7fa48dd4faa7c88c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Creating volume ca1ae2a8-01cc-4f82-8813-b13895458b90 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:50 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "cinder-db9640c5-548f-437b-a166-4239a38ae45b-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.582s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Deleted volume successfully.
Sep 23 00:21:50 devstack sudo[97177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 1073741824
Sep 23 00:21:50 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-055d6283-4286-4af9-a426-f5830e140ca2 tempest-VolumesImageMetadata-1178175563 None] Lock "cinder-9078cdef-cd11-434d-ad3c-54187ce4fcf0-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Acquiring lock "cinder-quobyte-db9640c5-548f-437b-a166-4239a38ae45b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "cinder-quobyte-db9640c5-548f-437b-a166-4239a38ae45b" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ec8304-798c-4d89-9c25-b8a82170c65a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:50 devstack sudo[97179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b
Sep 23 00:21:50 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:51 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 1073741824" returned: 0 in 0.778s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:51 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b" returned: 0 in 0.629s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:51 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b
Sep 23 00:21:51 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:51 devstack sudo[97191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90
Sep 23 00:21:51 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:51 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db9640c5-548f-437b-a166-4239a38ae45b" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "cinder-quobyte-db9640c5-548f-437b-a166-4239a38ae45b" released by "delete_volume" :: held 1.167s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:51 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a628e7a-bdc9-48ec-b3ab-ab37730d9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1ae2a8-01cc-4f82-8813-b13895458b90', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15dd7e4-dfda-4f11-b080-852a3a410602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:51 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Volume volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 (ca1ae2a8-01cc-4f82-8813-b13895458b90): created successfully
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15dd7e4-dfda-4f11-b080-852a3a410602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Flow 'volume_create_manager' (3913cd2c-fe1c-4f2f-877e-eae1d4b06838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Created reservations ['d1dc02ee-2564-4f51-9d74-fa4ab7f629ff', '24a00d63-48c7-4d97-af59-12645899b775', 'a2e1bb1e-396a-49a0-abee-a08d649d2afe', '5618a984-5dc8-4d46-bf55-fc31f064f8e8', '4e16cbdb-fbd1-4c70-90fb-d0b456d45e2d'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:21:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-95a205e8-19ca-488c-bc5a-9ae26b13135c tempest-VolumesListAdminTestJSON-556745982 None] Created volume successfully.
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:52 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:21:52 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:52 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:52 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:52 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Deleted volume successfully.
Sep 23 00:21:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d5ce14ca-9057-48fb-a042-d57d9b7e035c tempest-VolumeQuotasNegativeTestJSON-408934019 None] Lock "cinder-db9640c5-548f-437b-a166-4239a38ae45b-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Flow 'volume_create_manager' (6e20a72d-0049-4094-8550-9bd730dc89e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa42e17-4341-4103-ac7d-1448c37d61a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa42e17-4341-4103-ac7d-1448c37d61a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1927831658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d68829-0e2f-4757-931f-6a61c08b0dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c807dcc40c24445e94570ef89433e820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:53Z,use_quota=True,user_id='7f8da9c0657a4f7fa48dd4faa7c88c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d875b2d7-72c9-425e-ad45-4b13df01c3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d875b2d7-72c9-425e-ad45-4b13df01c3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95019d8a-e391-4c61-8b65-564b4e422ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95019d8a-e391-4c61-8b65-564b4e422ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d68829-0e2f-4757-931f-6a61c08b0dab', 'volume_name': 'volume-e9d68829-0e2f-4757-931f-6a61c08b0dab', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84659ad5-2b0f-491e-8dd2-ba08be0adf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84659ad5-2b0f-491e-8dd2-ba08be0adf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4869536-5472-4aa4-8b39-45da0fa9e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:53 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Volume e9d68829-0e2f-4757-931f-6a61c08b0dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d68829-0e2f-4757-931f-6a61c08b0dab', 'volume_size': 1}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1927831658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d68829-0e2f-4757-931f-6a61c08b0dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c807dcc40c24445e94570ef89433e820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:53Z,use_quota=True,user_id='7f8da9c0657a4f7fa48dd4faa7c88c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Creating volume e9d68829-0e2f-4757-931f-6a61c08b0dab {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:53 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:53 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab 1073741824
Sep 23 00:21:53 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:53 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab 1073741824" returned: 0 in 0.564s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:53 devstack sudo[97204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab
Sep 23 00:21:53 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:54 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab" returned: 0 in 0.380s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4869536-5472-4aa4-8b39-45da0fa9e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d68829-0e2f-4757-931f-6a61c08b0dab', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d63e1f-2681-4cb8-9ed6-0cf009682590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:54 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Volume volume-e9d68829-0e2f-4757-931f-6a61c08b0dab (e9d68829-0e2f-4757-931f-6a61c08b0dab): created successfully
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d63e1f-2681-4cb8-9ed6-0cf009682590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Flow 'volume_create_manager' (6e20a72d-0049-4094-8550-9bd730dc89e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:54 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5316e786-af52-4c1a-b313-2aad381b72e6 tempest-VolumesListAdminTestJSON-556745982 None] Created volume successfully.
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Flow 'volume_create_manager' (bc73f924-fd06-4ffa-8208-436405b9a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d646ca-3e31-4aef-8265-49abad24c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d646ca-3e31-4aef-8265-49abad24c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1816234063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f1a727-b74a-4c4f-a4f8-21e49f5fdc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c807dcc40c24445e94570ef89433e820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:56Z,use_quota=True,user_id='7f8da9c0657a4f7fa48dd4faa7c88c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5064a391-ed23-4fac-b6a3-b35fc8767db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5064a391-ed23-4fac-b6a3-b35fc8767db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccfb477-0ef2-4e39-84b5-499650ca5ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccfb477-0ef2-4e39-84b5-499650ca5ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f1a727-b74a-4c4f-a4f8-21e49f5fdc22', 'volume_name': 'volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebce7dd-b42f-47a8-a9f6-103334101628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebce7dd-b42f-47a8-a9f6-103334101628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda12db0-4994-4492-b8e1-92e41a008970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:56 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Volume 82f1a727-b74a-4c4f-a4f8-21e49f5fdc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22', 'volume_size': 1}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1816234063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f1a727-b74a-4c4f-a4f8-21e49f5fdc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c807dcc40c24445e94570ef89433e820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:56Z,use_quota=True,user_id='7f8da9c0657a4f7fa48dd4faa7c88c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Creating volume 82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:56 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:56 devstack sudo[97209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 1073741824
Sep 23 00:21:56 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:57 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 1073741824" returned: 0 in 0.727s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:57 devstack sudo[97215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22
Sep 23 00:21:57 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:57 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22" returned: 0 in 0.436s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda12db0-4994-4492-b8e1-92e41a008970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd81018b-04d2-4335-b2f2-f2dd6bfec749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:57 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Volume volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 (82f1a727-b74a-4c4f-a4f8-21e49f5fdc22): created successfully
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd81018b-04d2-4335-b2f2-f2dd6bfec749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Flow 'volume_create_manager' (bc73f924-fd06-4ffa-8208-436405b9a737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2642bb3b-316b-4653-8cf8-f12b5e55b357 tempest-VolumesListAdminTestJSON-556745982 None] Created volume successfully.
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Flow 'volume_create_manager' (c4c66078-b5cf-4757-b8ad-4e413eb3e5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c283ea4a-5c3e-4d0d-8fac-607a39229a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c283ea4a-5c3e-4d0d-8fac-607a39229a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1783202541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877f1efb-a8c2-4e61-a08e-cbc22985ee0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b5c4dc47cd4eda8702d995cabe5b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:58Z,use_quota=True,user_id='cb5ae0cac94a47fb8a17c7544a70aa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16fb650-c026-4c15-8d66-809adf9db221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16fb650-c026-4c15-8d66-809adf9db221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ebd3e0-34a1-49a1-9f30-fc44dfb34c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ebd3e0-34a1-49a1-9f30-fc44dfb34c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877f1efb-a8c2-4e61-a08e-cbc22985ee0c', 'volume_name': 'volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66014858-9e4d-4171-91c5-21061d23bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66014858-9e4d-4171-91c5-21061d23bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282b1f04-ebc2-48a6-804d-0068c50fcf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Volume 877f1efb-a8c2-4e61-a08e-cbc22985ee0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c', 'volume_size': 1}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1783202541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877f1efb-a8c2-4e61-a08e-cbc22985ee0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b5c4dc47cd4eda8702d995cabe5b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:58Z,use_quota=True,user_id='cb5ae0cac94a47fb8a17c7544a70aa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Creating volume 877f1efb-a8c2-4e61-a08e-cbc22985ee0c {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:58 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:58 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c 1073741824
Sep 23 00:21:58 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:58 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c 1073741824" returned: 0 in 0.562s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:59 devstack sudo[97227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c
Sep 23 00:21:59 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:59 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c" returned: 0 in 0.624s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282b1f04-ebc2-48a6-804d-0068c50fcf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d3f572-538c-4706-b136-224f2ea216a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Volume volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c (877f1efb-a8c2-4e61-a08e-cbc22985ee0c): created successfully
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d3f572-538c-4706-b136-224f2ea216a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Flow 'volume_create_manager' (c4c66078-b5cf-4757-b8ad-4e413eb3e5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7bb099a7-d33a-4a23-96b1-629b0c47c735 tempest-VolumesMetadataTest-1715667322 None] Created volume successfully.
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Flow 'volume_create_manager' (6ce6d941-62f2-4165-ac61-47e284de7464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508174d1-abfc-4126-9697-c1536df90c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508174d1-abfc-4126-9697-c1536df90c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32443554-ecf8-481d-9572-5a5e6964b609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c36736e604149439138440c2aebcee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:00Z,use_quota=True,user_id='60c532eedf354686aeb1c823c6db7fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8ab6b1-d684-48b5-bd4a-5e6f0321175e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8ab6b1-d684-48b5-bd4a-5e6f0321175e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988b6b08-e45c-4a6b-8f25-15cd36f6b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988b6b08-e45c-4a6b-8f25-15cd36f6b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32443554-ecf8-481d-9572-5a5e6964b609', 'volume_name': 'volume-32443554-ecf8-481d-9572-5a5e6964b609', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec92006-fcaf-4b46-b25b-85c48b051390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec92006-fcaf-4b46-b25b-85c48b051390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584ee662-2d3a-4877-b84d-4b14a1e1731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Volume 32443554-ecf8-481d-9572-5a5e6964b609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32443554-ecf8-481d-9572-5a5e6964b609', 'volume_size': 1}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32443554-ecf8-481d-9572-5a5e6964b609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c36736e604149439138440c2aebcee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:00Z,use_quota=True,user_id='60c532eedf354686aeb1c823c6db7fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Creating volume 32443554-ecf8-481d-9572-5a5e6964b609 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:00 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:00 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609 1073741824
Sep 23 00:22:00 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:00 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609 1073741824" returned: 0 in 0.600s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:00 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609
Sep 23 00:22:00 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:00 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609" returned: 0 in 0.289s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584ee662-2d3a-4877-b84d-4b14a1e1731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32443554-ecf8-481d-9572-5a5e6964b609', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267d6c4b-12b3-4df3-8fdf-2ebfb6b724d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:01 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Volume volume-32443554-ecf8-481d-9572-5a5e6964b609 (32443554-ecf8-481d-9572-5a5e6964b609): created successfully
Sep 23 00:22:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267d6c4b-12b3-4df3-8fdf-2ebfb6b724d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Flow 'volume_create_manager' (6ce6d941-62f2-4165-ac61-47e284de7464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9b593771-5f41-4846-adac-d79efafcf85e tempest-VolumesListAdminTestJSON-57438653 None] Created volume successfully.
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Acquiring lock "cinder-877f1efb-a8c2-4e61-a08e-cbc22985ee0c-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Lock "cinder-877f1efb-a8c2-4e61-a08e-cbc22985ee0c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Acquiring lock "cinder-quobyte-877f1efb-a8c2-4e61-a08e-cbc22985ee0c" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Lock "cinder-quobyte-877f1efb-a8c2-4e61-a08e-cbc22985ee0c" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06e616d-1119-46e4-a2bb-97ad6ccb3ee9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Acquiring lock "cinder-32443554-ecf8-481d-9572-5a5e6964b609-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Lock "cinder-32443554-ecf8-481d-9572-5a5e6964b609-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:02 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c
Sep 23 00:22:02 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Acquiring lock "cinder-quobyte-32443554-ecf8-481d-9572-5a5e6964b609" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Lock "cinder-quobyte-32443554-ecf8-481d-9572-5a5e6964b609" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7701c24-999a-464a-a24a-78cc4fb9b5bb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "cinder-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "cinder-quobyte-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-quobyte-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22" acquired by "delete_volume" :: waited 0.046s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:02 devstack sudo[97242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609
Sep 23 00:22:02 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b15811-280d-4e22-afcf-1ae0722f1c0e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:02 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c" returned: 0 in 0.667s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:02 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c
Sep 23 00:22:02 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:02 devstack sudo[97248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22
Sep 23 00:22:02 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:03 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-877f1efb-a8c2-4e61-a08e-cbc22985ee0c" returned: 0 in 0.369s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:03 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609" returned: 0 in 0.672s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Lock "cinder-quobyte-877f1efb-a8c2-4e61-a08e-cbc22985ee0c" released by "delete_volume" :: held 1.164s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:03 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609
Sep 23 00:22:03 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Created reservations ['53b36921-9c6f-420a-866b-a186d141a5b4', 'd6451765-8474-457c-8369-53f7ecf186c5', '5d06f875-dafd-4e10-9c96-789adb848d45', '8e466f73-3036-4b08-a1e3-56d9873a6a6d', '7e9dd3c0-6475-4989-9d69-18e420aa9870'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:03 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22" returned: 0 in 0.690s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:03 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22
Sep 23 00:22:03 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:03 devstack sudo[97264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:03 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:03 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32443554-ecf8-481d-9572-5a5e6964b609" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Lock "cinder-quobyte-32443554-ecf8-481d-9572-5a5e6964b609" released by "delete_volume" :: held 1.291s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:03 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Flow 'volume_create_manager' (9833c45b-886a-4f7b-ae6d-8679a377764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed29b57-5b45-4b7e-9f96-e722ac0a2f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed29b57-5b45-4b7e-9f96-e722ac0a2f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1934913871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a09de1d-719b-4b21-ad6e-60d6aa925f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cabb0888e245dd96903b104d603c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:04Z,use_quota=True,user_id='22f48eadec934afe8ef8d2774c7d95ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7b6625-fdfa-40e4-aca0-1b97c20635cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7b6625-fdfa-40e4-aca0-1b97c20635cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7c870c-3618-4100-ab85-c30fd5f40fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7c870c-3618-4100-ab85-c30fd5f40fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a09de1d-719b-4b21-ad6e-60d6aa925f50', 'volume_name': 'volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130849b7-a0a3-4204-84f0-67ecd9072ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130849b7-a0a3-4204-84f0-67ecd9072ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c2fd5c-cb52-4d0e-b886-02124da2f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:04 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Volume 6a09de1d-719b-4b21-ad6e-60d6aa925f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50', 'volume_size': 1}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1934913871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a09de1d-719b-4b21-ad6e-60d6aa925f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cabb0888e245dd96903b104d603c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:04Z,use_quota=True,user_id='22f48eadec934afe8ef8d2774c7d95ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Creating volume 6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:04 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:04 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:04 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22" returned: 0 in 0.694s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:04 devstack sudo[97269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 1073741824
Sep 23 00:22:04 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.636s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-quobyte-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22" released by "delete_volume" :: held 1.466s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Deleted volume successfully.
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Created reservations ['ea963b1b-b8e9-46c1-8005-cc1784256e88', 'ecbb9c0c-91a3-4287-a9bf-530a183f886b', 'd79af779-a69b-43b0-8bfa-b6abdfa8b1d8', 'e2017208-b418-42f2-bed8-ebe1f3eaa54e', '3d5ba1ed-88b0-4fe5-8d11-a4c52d2635e3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-62787d5f-2ce4-458f-bb2a-bfc20cd39b59 tempest-VolumesMetadataTest-1715667322 None] Lock "cinder-877f1efb-a8c2-4e61-a08e-cbc22985ee0c-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Created reservations ['8de911d0-ce38-4c82-af0a-bdcf376681e9', 'd11ab271-be4a-47e9-ac28-0ab1063706a1', '48b5b3fe-84aa-48b2-9477-69287def13c2', '1d0f4b3a-8a76-4b22-b836-f031cfc72814', '27f03a6f-40bd-41c3-8222-3dcfdb52b149'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:04 devstack sudo[97272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:04 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:04 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:04 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:04 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.346s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Deleted volume successfully.
Sep 23 00:22:04 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 1073741824" returned: 0 in 0.674s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29e015b5-1f03-4b42-9330-2c79d3384f37 tempest-VolumesListAdminTestJSON-57438653 None] Lock "cinder-32443554-ecf8-481d-9572-5a5e6964b609-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:04 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.325s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Deleted volume successfully.
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98d13f93-a02b-4834-a88f-b178bcf566b3 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-82f1a727-b74a-4c4f-a4f8-21e49f5fdc22-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:04 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50
Sep 23 00:22:04 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "cinder-e9d68829-0e2f-4757-931f-6a61c08b0dab-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-e9d68829-0e2f-4757-931f-6a61c08b0dab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "cinder-quobyte-e9d68829-0e2f-4757-931f-6a61c08b0dab" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:05 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50" returned: 0 in 0.308s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-quobyte-e9d68829-0e2f-4757-931f-6a61c08b0dab" acquired by "delete_volume" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c2fd5c-cb52-4d0e-b886-02124da2f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c19853-cbe2-4093-9955-11026857c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d1fce-458a-4ac6-ae86-07f563c73a22]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Volume volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 (6a09de1d-719b-4b21-ad6e-60d6aa925f50): created successfully
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c19853-cbe2-4093-9955-11026857c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Flow 'volume_create_manager' (9833c45b-886a-4f7b-ae6d-8679a377764a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9287cccc-cc7d-497a-a1d9-6ec961669722 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Created volume successfully.
Sep 23 00:22:05 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab
Sep 23 00:22:05 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Flow 'volume_create_manager' (c94071f4-5b2e-4b63-8c71-948153b3ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee310c0-a425-4d7c-808d-ffff884b07e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee310c0-a425-4d7c-808d-ffff884b07e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1568626460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce52b74c-fc34-43ed-bbf7-86cfd8edf70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5835c05e942f46de8a7b2563841e2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:06Z,use_quota=True,user_id='bb615ffa0b7e4031bdd4863d1826fd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b0c698-479d-4712-a665-09311192d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:05 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b0c698-479d-4712-a665-09311192d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afc77b4-93a7-47de-8f34-ff320fb4de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afc77b4-93a7-47de-8f34-ff320fb4de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce52b74c-fc34-43ed-bbf7-86cfd8edf70f', 'volume_name': 'volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36247e2-6b18-4944-8794-802d3c48b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36247e2-6b18-4944-8794-802d3c48b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b23d218-371a-40bb-b53f-2d5de26f0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Volume ce52b74c-fc34-43ed-bbf7-86cfd8edf70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f', 'volume_size': 1}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1568626460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce52b74c-fc34-43ed-bbf7-86cfd8edf70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5835c05e942f46de8a7b2563841e2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:06Z,use_quota=True,user_id='bb615ffa0b7e4031bdd4863d1826fd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Creating volume ce52b74c-fc34-43ed-bbf7-86cfd8edf70f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:05 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab" returned: 0 in 0.551s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:05 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f 1073741824
Sep 23 00:22:05 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:05 devstack sudo[97290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab
Sep 23 00:22:05 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:06 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e9d68829-0e2f-4757-931f-6a61c08b0dab" returned: 0 in 0.416s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-quobyte-e9d68829-0e2f-4757-931f-6a61c08b0dab" released by "delete_volume" :: held 1.033s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Created reservations ['7b7feb19-75e3-40c8-95c9-e63dcab50961', 'e4b10bda-f168-4c3d-b547-7fa54574f665', '5df44a9a-1c3b-4b26-a8e9-696973eb8068', '67d10a5f-16ae-44e1-9aac-39f1f5836a61', 'b7210740-14a2-48c7-b652-7b6fcbf89003'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:06 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f 1073741824" returned: 0 in 0.714s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:06 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:06 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:06 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f
Sep 23 00:22:06 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:06 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.299s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Deleted volume successfully.
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-eacdfbff-7137-43c2-a908-ad4419db2926 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-e9d68829-0e2f-4757-931f-6a61c08b0dab-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:06 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f" returned: 0 in 0.336s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.472s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b23d218-371a-40bb-b53f-2d5de26f0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d9baee-d738-46e6-a0c1-60e3dea95e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Creating offline snapshot 439e335a-b143-41ff-ac54-025c35376b18 of volume 6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:22:06 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Volume volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f (ce52b74c-fc34-43ed-bbf7-86cfd8edf70f): created successfully
Sep 23 00:22:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d9baee-d738-46e6-a0c1-60e3dea95e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Flow 'volume_create_manager' (c94071f4-5b2e-4b63-8c71-948153b3ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b602542e-86b4-4d59-a60a-dd8f01d03274]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:07 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ea5d82bd-ab29-4261-a2d6-127e1cdb8cd0 tempest-VolumesTransfersV355Test-2124238992 None] Created volume successfully.
Sep 23 00:22:07 devstack sudo[97305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50
Sep 23 00:22:07 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:07 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50" returned: 0 in 0.474s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:07 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 1G
Sep 23 00:22:07 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "cinder-ca1ae2a8-01cc-4f82-8813-b13895458b90-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-ca1ae2a8-01cc-4f82-8813-b13895458b90-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "cinder-quobyte-ca1ae2a8-01cc-4f82-8813-b13895458b90" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-quobyte-ca1ae2a8-01cc-4f82-8813-b13895458b90" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e1b0b-cd22-48a8-b031-1e7843503e6b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:07 devstack sudo[97313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90
Sep 23 00:22:07 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:08 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 1G" returned: 0 in 0.649s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:08 devstack sudo[97317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18
Sep 23 00:22:08 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:08 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90" returned: 0 in 0.605s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:08 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90
Sep 23 00:22:08 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:08 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18" returned: 0 in 0.483s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:08 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 is being set with open permissions: ugo+rw
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:08 devstack sudo[97328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18
Sep 23 00:22:08 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:08 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ca1ae2a8-01cc-4f82-8813-b13895458b90" returned: 0 in 0.364s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-quobyte-ca1ae2a8-01cc-4f82-8813-b13895458b90" released by "delete_volume" :: held 1.056s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Created reservations ['a92f7d5b-13b2-45a3-8f2a-401db2fa1392', '17ae95bb-9d85-4621-8899-bc342ac49ead', '05ca7224-4fad-47f1-aae7-c605e009de0c', '17818a75-f4bc-4d26-b335-09b48e57f0ba', 'baa1abc5-3d61-4372-9762-1110ce83c5a5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:08 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18" returned: 0 in 0.350s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:09 devstack sudo[97332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info
Sep 23 00:22:09 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:09 devstack sudo[97333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:09 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:09 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.336s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Deleted volume successfully.
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-970951ec-60a6-44cd-a43d-88715b65add6 tempest-VolumesListAdminTestJSON-556745982 None] Lock "cinder-ca1ae2a8-01cc-4f82-8813-b13895458b90-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-be327e1f-aace-4f33-a42a-0a99729c49ae tempest-VolumesTransfersV355Test-1073607113 None] Transfer volume completed successfully.
Sep 23 00:22:09 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:09 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info is being set with open permissions: ugo+rw
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:09 devstack sudo[97338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info
Sep 23 00:22:09 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:09 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.info" returned: 0 in 0.383s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.996s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1560ee4c-fc14-418a-8d99-3d451673e8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Create snapshot completed successfully
Sep 23 00:22:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Acquiring lock "cinder-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Acquiring lock "cinder-quobyte-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-quobyte-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c424f-7f14-48ae-8923-157dde7ab1db]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:10 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f
Sep 23 00:22:10 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:11 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f" returned: 0 in 0.512s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:11 devstack sudo[97348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f
Sep 23 00:22:11 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "cinder-439e335a-b143-41ff-ac54-025c35376b18-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-439e335a-b143-41ff-ac54-025c35376b18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "cinder-quobyte-6a09de1d-719b-4b21-ad6e-60d6aa925f50" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-quobyte-6a09de1d-719b-4b21-ad6e-60d6aa925f50" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "cinder-quobyte-439e335a-b143-41ff-ac54-025c35376b18" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-quobyte-439e335a-b143-41ff-ac54-025c35376b18" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Deleting offline snapshot 439e335a-b143-41ff-ac54-025c35376b18 of volume 6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] snapshot_file for this snap is: volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:22:11 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f" returned: 0 in 0.427s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8fc29-9723-4c47-b020-82e0c459afea]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-quobyte-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f" released by "delete_volume" :: held 1.035s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Created reservations ['035580fc-f044-40c7-bd1d-3e30cfc487ef', '8310184b-0d48-430e-8db7-c6d830c9d163', '8c708f73-39f4-47f3-b9fb-e1c731e805c9', 'e826536d-b631-4b45-80c2-147eb177d15d', '8d0ff41e-d6c2-47ce-ba81-33886c0627e6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:11 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18
Sep 23 00:22:11 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:12 devstack sudo[97353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:12 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:12 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18" returned: 0 in 0.787s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:22:12 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Deleted volume successfully.
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f87765-3f54-4cb7-ba3d-1b0956ad68ec]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f54df585-8c8a-4f87-996b-9a78f6becf13 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-ce52b74c-fc34-43ed-bbf7-86cfd8edf70f-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:12 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50
Sep 23 00:22:12 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Flow 'volume_create_manager' (23e8d3b4-b777-4927-9f9c-54ff371a0578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b7a15-5b95-4594-8c3f-1a948d99ce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b7a15-5b95-4594-8c3f-1a948d99ce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-100129564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbe1756-ae99-4ff7-982c-e8629277d574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5ab59cd7d410e8539f065717e7dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:13Z,use_quota=True,user_id='531e1be182ae481bac2a75f7201750af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec63bb7-0cd0-489c-bcc8-27345e5f01c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec63bb7-0cd0-489c-bcc8-27345e5f01c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6162569-69a0-49db-b49e-b620683561c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6162569-69a0-49db-b49e-b620683561c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bbe1756-ae99-4ff7-982c-e8629277d574', 'volume_name': 'volume-6bbe1756-ae99-4ff7-982c-e8629277d574', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ad01ad-2c65-447a-a8ac-db6787100920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ad01ad-2c65-447a-a8ac-db6787100920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5549f6-01ac-4c78-a0dc-147c24c4ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Volume 6bbe1756-ae99-4ff7-982c-e8629277d574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bbe1756-ae99-4ff7-982c-e8629277d574', 'volume_size': 1}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-100129564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbe1756-ae99-4ff7-982c-e8629277d574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5ab59cd7d410e8539f065717e7dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:13Z,use_quota=True,user_id='531e1be182ae481bac2a75f7201750af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Creating volume 6bbe1756-ae99-4ff7-982c-e8629277d574 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:12 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack sudo[97367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574 1073741824
Sep 23 00:22:13 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:13 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50" returned: 0 in 0.669s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack sudo[97372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18
Sep 23 00:22:13 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:13 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574 1073741824" returned: 0 in 0.774s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18" returned: 0 in 0.679s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:13 devstack sudo[97381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:13 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18
Sep 23 00:22:13 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Flow 'volume_create_manager' (03065bf8-6d5c-482a-9902-90be8b19733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca405205-443f-41d7-b2a1-291c251a11b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca405205-443f-41d7-b2a1-291c251a11b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-864319417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39757bd0-11ee-4d14-b44b-5c88a9ec6ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5835c05e942f46de8a7b2563841e2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:14Z,use_quota=True,user_id='bb615ffa0b7e4031bdd4863d1826fd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e03389-ec1a-4eb5-8991-e67c0d3a1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e03389-ec1a-4eb5-8991-e67c0d3a1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b8d7aa-dc4a-4848-9aa0-c8cda6646040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b8d7aa-dc4a-4848-9aa0-c8cda6646040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39757bd0-11ee-4d14-b44b-5c88a9ec6ebc', 'volume_name': 'volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d0685e-2325-45c0-8469-b0ecb38f3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d0685e-2325-45c0-8469-b0ecb38f3865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c986d5a8-21d7-48a9-854a-baceea0e49c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Volume 39757bd0-11ee-4d14-b44b-5c88a9ec6ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc', 'volume_size': 1}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:14 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574" returned: 0 in 0.306s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-864319417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39757bd0-11ee-4d14-b44b-5c88a9ec6ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5835c05e942f46de8a7b2563841e2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:14Z,use_quota=True,user_id='bb615ffa0b7e4031bdd4863d1826fd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Creating volume 39757bd0-11ee-4d14-b44b-5c88a9ec6ebc {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:14 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:14 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50.439e335a-b143-41ff-ac54-025c35376b18" returned: 0 in 0.317s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5549f6-01ac-4c78-a0dc-147c24c4ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbe1756-ae99-4ff7-982c-e8629277d574', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:14 devstack sudo[97387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc 1073741824
Sep 23 00:22:14 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98fc4c3-8c60-49a2-9b0a-6230b2266b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Volume volume-6bbe1756-ae99-4ff7-982c-e8629277d574 (6bbe1756-ae99-4ff7-982c-e8629277d574): created successfully
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98fc4c3-8c60-49a2-9b0a-6230b2266b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Flow 'volume_create_manager' (23e8d3b4-b777-4927-9f9c-54ff371a0578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-quobyte-439e335a-b143-41ff-ac54-025c35376b18" released by "_delete_snapshot" :: held 2.683s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6f6479cc-f886-4da8-aa1a-9bb24baeae08 tempest-VolumesTransfersV357Test-679116534 None] Created volume successfully.
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-quobyte-6a09de1d-719b-4b21-ad6e-60d6aa925f50" released by "delete_snapshot" :: held 2.733s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Created reservations ['e9098f08-b88d-49eb-8d28-431a4b2926a8', '1304fdd0-9e61-49bc-bfe2-d5b228066bcd', '3c0e385a-cad2-4731-80a8-41c29c5ed88b', 'ad49300c-165e-41ea-af89-75fc457a18b9', 'cf79a274-39c5-4bcb-9f40-d208bbb2ebcf'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Delete snapshot completed successfully.
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fd3850bb-34cd-46f4-a549-6b9b004d0eac tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-439e335a-b143-41ff-ac54-025c35376b18-delete_snapshot" released by "delete_snapshot" :: held 2.952s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:14 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc 1073741824" returned: 0 in 0.646s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "cinder-6a09de1d-719b-4b21-ad6e-60d6aa925f50-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:14 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc
Sep 23 00:22:14 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-6a09de1d-719b-4b21-ad6e-60d6aa925f50-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "cinder-quobyte-6a09de1d-719b-4b21-ad6e-60d6aa925f50" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-quobyte-6a09de1d-719b-4b21-ad6e-60d6aa925f50" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bcaf96-d7a3-4195-90c0-d38807eafd4a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:15 devstack sudo[97395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50
Sep 23 00:22:15 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:15 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc" returned: 0 in 0.486s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c986d5a8-21d7-48a9-854a-baceea0e49c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bca4bb6-6c19-4d69-a3cd-69d6f09d6044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Volume volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc (39757bd0-11ee-4d14-b44b-5c88a9ec6ebc): created successfully
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bca4bb6-6c19-4d69-a3cd-69d6f09d6044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Flow 'volume_create_manager' (03065bf8-6d5c-482a-9902-90be8b19733b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1eee18da-191f-4054-a7bb-e8fa3808dee4 tempest-VolumesTransfersV355Test-2124238992 None] Created volume successfully.
Sep 23 00:22:15 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50" returned: 0 in 0.747s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:15 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50
Sep 23 00:22:15 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:16 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6a09de1d-719b-4b21-ad6e-60d6aa925f50" returned: 0 in 0.443s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-quobyte-6a09de1d-719b-4b21-ad6e-60d6aa925f50" released by "delete_volume" :: held 1.306s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cb0bbbdd-03c9-46f5-8cf0-dd71fd9567d1 tempest-VolumesTransfersV357Test-168981475 None] Transfer volume completed successfully.
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Created reservations ['67109b31-7792-4132-96a1-7fe1042f6603', '52663d30-f80f-4b77-a11f-071f94cce2a5', '2b7a7fa1-a6b4-4397-b59e-4e0988f245cb', '13f5c582-0683-4665-bd61-b039e92c4851', 'c0d968b2-5ec7-4288-b45b-9a20ed9b23bb'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Acquiring lock "cinder-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:16 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:16 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Acquiring lock "cinder-quobyte-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-quobyte-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df7b81-fc82-4065-b60d-75da7b22a19f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:16 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc
Sep 23 00:22:16 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:16 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:16 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Deleted volume successfully.
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-95c5c384-bef9-4d02-af44-8d992df0acc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-220152827 None] Lock "cinder-6a09de1d-719b-4b21-ad6e-60d6aa925f50-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:17 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc" returned: 0 in 0.506s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:17 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc
Sep 23 00:22:17 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:17 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Acquiring lock "cinder-6bbe1756-ae99-4ff7-982c-e8629277d574-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc" returned: 0 in 0.364s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-quobyte-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc" released by "delete_volume" :: held 0.947s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-6bbe1756-ae99-4ff7-982c-e8629277d574-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Acquiring lock "cinder-quobyte-6bbe1756-ae99-4ff7-982c-e8629277d574" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-quobyte-6bbe1756-ae99-4ff7-982c-e8629277d574" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Created reservations ['1d69c949-5002-4a46-b553-04326a8364ad', '097848a5-a0d0-42a1-9afa-1e0a770b8cb7', 'c215f82f-1bc4-4161-85e9-63d12db7df1b', '4aabb2d6-4c5c-4506-baac-3cc9024213cb', '6a4bd953-97d3-49b4-856a-89db1e158082'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3f814e-e726-44e4-8a44-cb896b958b94]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:18 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:18 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:18 devstack sudo[97451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574
Sep 23 00:22:18 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:18 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.356s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Deleted volume successfully.
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ea39202f-b9fc-47ea-a9e8-5421ac8533b5 tempest-VolumesTransfersV355Test-1927307661 None] Lock "cinder-39757bd0-11ee-4d14-b44b-5c88a9ec6ebc-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:18 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:18 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574
Sep 23 00:22:18 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:18 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bbe1756-ae99-4ff7-982c-e8629277d574" returned: 0 in 0.438s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-quobyte-6bbe1756-ae99-4ff7-982c-e8629277d574" released by "delete_volume" :: held 1.177s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Created reservations ['4995b47d-2128-40f8-8d43-9c98baf06ec7', '31bba7ef-bbb6-4e99-9d49-7de308f93a7a', '8cd519f0-4aea-41b9-99b0-ad48fcc29b06', 'b432673b-5c4d-43b1-8b57-10c2db631b1b', '3af15c3f-5128-4d2e-971e-20600a99acac'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:19 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:19 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:19 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.487s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Deleted volume successfully.
Sep 23 00:22:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-23f492be-5d43-4d61-b1ef-3e07b43fdd70 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-6bbe1756-ae99-4ff7-982c-e8629277d574-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Flow 'volume_create_manager' (7ba60008-67d6-4b89-b3a0-17f7a3ca77e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf83a4d-de10-45af-bec4-fb00993fdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf83a4d-de10-45af-bec4-fb00993fdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1642629219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca4ec4c-70ce-4142-9f40-3ab5c72f1b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5ab59cd7d410e8539f065717e7dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:21Z,use_quota=True,user_id='531e1be182ae481bac2a75f7201750af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08836ce-86ff-458c-b304-e5530b6f27ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08836ce-86ff-458c-b304-e5530b6f27ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0bee27-7d1b-43df-8b0f-6ff367d444e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0bee27-7d1b-43df-8b0f-6ff367d444e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca4ec4c-70ce-4142-9f40-3ab5c72f1b30', 'volume_name': 'volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b456e6a0-6d92-4170-9ac5-c3d1fe989cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b456e6a0-6d92-4170-9ac5-c3d1fe989cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b800d09b-20f6-46e0-9b9f-b08cdcee1688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:20 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Volume fca4ec4c-70ce-4142-9f40-3ab5c72f1b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30', 'volume_size': 1}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1642629219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca4ec4c-70ce-4142-9f40-3ab5c72f1b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5ab59cd7d410e8539f065717e7dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:21Z,use_quota=True,user_id='531e1be182ae481bac2a75f7201750af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Creating volume fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:21 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:21 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 1073741824
Sep 23 00:22:21 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:21 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 1073741824" returned: 0 in 0.686s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:21 devstack sudo[97472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30
Sep 23 00:22:21 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:22 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30" returned: 0 in 0.587s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b800d09b-20f6-46e0-9b9f-b08cdcee1688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8b3c67-46d4-4f1f-9180-c7116dd1955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:22 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Volume volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 (fca4ec4c-70ce-4142-9f40-3ab5c72f1b30): created successfully
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8b3c67-46d4-4f1f-9180-c7116dd1955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Flow 'volume_create_manager' (7ba60008-67d6-4b89-b3a0-17f7a3ca77e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-50dfa35e-9378-4348-8ecf-4fa21fc43a7b tempest-VolumesTransfersV357Test-679116534 None] Created volume successfully.
Sep 23 00:22:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Acquiring lock "cinder-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Acquiring lock "cinder-quobyte-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-quobyte-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30" acquired by "delete_volume" :: waited 0.046s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:24 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2074f353-b967-4b07-b224-5ed38e98dd61]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:24 devstack sudo[97475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30
Sep 23 00:22:24 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:24 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30" returned: 0 in 0.575s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:24 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30
Sep 23 00:22:24 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:25 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30" returned: 0 in 0.488s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-quobyte-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30" released by "delete_volume" :: held 1.179s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Created reservations ['665a5664-d11f-4674-877a-a2e0741672dc', '1917943d-3b86-445f-971e-e10860e565c3', '32a0db18-8520-4994-98c0-31dd6a4518ba', 'bc3d3fd3-d1a0-419e-8d1d-0c8b0dd16987', '967fe39c-6529-4327-97b7-bfed23b16650'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:25 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:25 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:25 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.376s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:25 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Deleted volume successfully.
Sep 23 00:22:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dbf47a66-ac9c-47e7-a602-ff3f591fe071 tempest-VolumesTransfersV357Test-574053885 None] Lock "cinder-fca4ec4c-70ce-4142-9f40-3ab5c72f1b30-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Flow 'volume_create_manager' (d62c4733-4ab4-4986-95c2-7c93c1a19321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a84041-a070-4893-b198-d530245e3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a84041-a070-4893-b198-d530245e3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1107420516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134001e7-85b4-4f50-a921-6bdecbd0feea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6044b22f4e459897ae4e58faf0e3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:28Z,use_quota=True,user_id='ab3b1c536b56412c92f079650f7c4b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f364258b-a629-4ab1-b32f-12fbe22a6502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f364258b-a629-4ab1-b32f-12fbe22a6502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74efe75-46ac-4e11-88d1-4db37d5855fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74efe75-46ac-4e11-88d1-4db37d5855fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134001e7-85b4-4f50-a921-6bdecbd0feea', 'volume_name': 'volume-134001e7-85b4-4f50-a921-6bdecbd0feea', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b52fac-e4e6-43c9-a229-9e0875f33ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b52fac-e4e6-43c9-a229-9e0875f33ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca3fb0e-7363-4111-b792-6a898f237694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Volume 134001e7-85b4-4f50-a921-6bdecbd0feea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134001e7-85b4-4f50-a921-6bdecbd0feea', 'volume_size': 1}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1107420516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134001e7-85b4-4f50-a921-6bdecbd0feea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6044b22f4e459897ae4e58faf0e3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:28Z,use_quota=True,user_id='ab3b1c536b56412c92f079650f7c4b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Creating volume 134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:28 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:28 devstack sudo[97486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea 1073741824
Sep 23 00:22:28 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:29 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea 1073741824" returned: 0 in 0.801s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:29 devstack sudo[97492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea
Sep 23 00:22:29 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:29 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea" returned: 0 in 0.448s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca3fb0e-7363-4111-b792-6a898f237694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134001e7-85b4-4f50-a921-6bdecbd0feea', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6b9b29-69ec-492a-9085-3fb5c6c3b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:29 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Volume volume-134001e7-85b4-4f50-a921-6bdecbd0feea (134001e7-85b4-4f50-a921-6bdecbd0feea): created successfully
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6b9b29-69ec-492a-9085-3fb5c6c3b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Flow 'volume_create_manager' (d62c4733-4ab4-4986-95c2-7c93c1a19321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-edd22cc6-a16c-4c40-bf36-fc988b11855e tempest-SnapshotMetadataTestJSON-1848953743 None] Created volume successfully.
Sep 23 00:22:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Creating offline snapshot 52e907cc-aae8-4c8a-8959-9fc088c1c20e of volume 134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:22:30 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ec7b4-cb40-49be-b2f8-876529bdb8dd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:31 devstack sudo[97496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea
Sep 23 00:22:31 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:31 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea" returned: 0 in 0.583s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:31 devstack sudo[97501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e 1G
Sep 23 00:22:31 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:32 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e 1G" returned: 0 in 0.762s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134001e7-85b4-4f50-a921-6bdecbd0feea -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:32 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134001e7-85b4-4f50-a921-6bdecbd0feea -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e
Sep 23 00:22:32 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Flow 'volume_create_manager' (6d666a4c-9313-4780-89b0-370d1e9f8482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63ac139-6c45-4601-970e-7537fdd4f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63ac139-6c45-4601-970e-7537fdd4f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-194570366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4af2d4-2826-48e5-b361-869b3544f80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f66b4544d84127b6c33149081ad33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:32Z,use_quota=True,user_id='47a773e495f04f5cacc94d257eeaa05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c52ab5-a50c-4e6b-be42-8e5d5ec1da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c52ab5-a50c-4e6b-be42-8e5d5ec1da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facd68ac-e988-4d53-8b5f-f6400bf04851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:22:32 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134001e7-85b4-4f50-a921-6bdecbd0feea -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e" returned: 0 in 0.543s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:32 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e is being set with open permissions: ugo+rw
Sep 23 00:22:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:32 devstack sudo[97511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e
Sep 23 00:22:32 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facd68ac-e988-4d53-8b5f-f6400bf04851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d4af2d4-2826-48e5-b361-869b3544f80f', 'volume_name': 'volume-5d4af2d4-2826-48e5-b361-869b3544f80f', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4c464e0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53c6e7-286f-4923-b60d-c32999eab357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53c6e7-286f-4923-b60d-c32999eab357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d6397a-9ec5-481b-9461-e5dedaea53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Volume 5d4af2d4-2826-48e5-b361-869b3544f80f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d4af2d4-2826-48e5-b361-869b3544f80f', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4c464e0>}
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Trying to clone 5d4af2d4-2826-48e5-b361-869b3544f80f from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:22:33 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e" returned: 0 in 0.619s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:33 devstack sudo[97514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info
Sep 23 00:22:33 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:22:33 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71903e-2048-4f6c-972c-b39ba5f4ed4e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:33 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:33 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info is being set with open permissions: ugo+rw
Sep 23 00:22:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:33 devstack sudo[97519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info
Sep 23 00:22:33 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:34 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD
Sep 23 00:22:34 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:34 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:34 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:34 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c is fetched for user 47a773e495f04f5cacc94d257eeaa05f. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:22:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.info" returned: 0 in 0.552s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.729s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e9e9c33e-ac4b-46cd-92fb-914a10a80923 tempest-SnapshotMetadataTestJSON-1848953743 None] Create snapshot completed successfully
Sep 23 00:22:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e7aaa2-f4d2-40d2-9170-1b1517f6a16b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:34 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD
Sep 23 00:22:34 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:35 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-194570366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4af2d4-2826-48e5-b361-869b3544f80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f66b4544d84127b6c33149081ad33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:32Z,use_quota=True,user_id='47a773e495f04f5cacc94d257eeaa05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Creating volume 5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:35 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:35 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 1073741824
Sep 23 00:22:35 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:36 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 1073741824" returned: 0 in 1.064s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=171,cinder:SELECT=114,cinder:INSERT=49,cinder:DELETE=17 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:36 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f
Sep 23 00:22:36 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:36 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f" returned: 0 in 0.482s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:36 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Attempting download of d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 5d4af2d4-2826-48e5-b361-869b3544f80f. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e6123-574a-4784-8501-d2d992639e2e]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "cinder-52e907cc-aae8-4c8a-8959-9fc088c1c20e-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:37 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25
Sep 23 00:22:37 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-52e907cc-aae8-4c8a-8959-9fc088c1c20e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "cinder-quobyte-134001e7-85b4-4f50-a921-6bdecbd0feea" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-quobyte-134001e7-85b4-4f50-a921-6bdecbd0feea" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "cinder-quobyte-52e907cc-aae8-4c8a-8959-9fc088c1c20e" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-quobyte-52e907cc-aae8-4c8a-8959-9fc088c1c20e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Deleting offline snapshot 52e907cc-aae8-4c8a-8959-9fc088c1c20e of volume 134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] snapshot_file for this snap is: volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef152f6-8cb7-4012-a8ad-ec654caa3869]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25" returned: 0 in 0.742s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:37 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:37 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e
Sep 23 00:22:37 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:38 devstack sudo[97548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25
Sep 23 00:22:38 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:38 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e" returned: 0 in 0.718s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-134001e7-85b4-4f50-a921-6bdecbd0feea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b46bf-a6a0-4592-9902-798fa485b8eb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:38 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25" returned: 1 in 0.719s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_p12hwy25' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f878e058-28e4-4bd1-a6c6-812a5688d57f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:38 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea
Sep 23 00:22:38 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:38 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD
Sep 23 00:22:38 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:39 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] d3316061-b3c0-4b6e-8b31-c56fbf284d8c was qcow2, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:39 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea" returned: 0 in 0.801s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:39 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f
Sep 23 00:22:39 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:39 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e
Sep 23 00:22:39 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:39 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e" returned: 0 in 0.652s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:39 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e
Sep 23 00:22:39 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:22:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:22:40 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea.52e907cc-aae8-4c8a-8959-9fc088c1c20e" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=133,cinder:UPDATE=150,cinder:INSERT=46,cinder:DELETE=10 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Flow 'volume_create_manager' (24bf1ca4-7f95-4ff8-88a4-b8f83be7c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7184cb7-7f00-4d03-b225-d99da4ca8a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7184cb7-7f00-4d03-b225-d99da4ca8a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-632132966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95864e19-68bc-4153-81d9-a12f4fc9d32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231b6546f9ba4dccb41484e0b8a73683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:40Z,use_quota=True,user_id='0cc69daacb304294b7b7b2de0fdd5e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d966d3-569c-4261-83a8-57243061974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d966d3-569c-4261-83a8-57243061974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349e0164-688e-49cf-8436-1b10750595be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349e0164-688e-49cf-8436-1b10750595be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95864e19-68bc-4153-81d9-a12f4fc9d32b', 'volume_name': 'volume-95864e19-68bc-4153-81d9-a12f4fc9d32b', 'volume_size': 2}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b236b57-f681-4d4b-98f5-1be1e73ee3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b236b57-f681-4d4b-98f5-1be1e73ee3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f0ad2-258b-4b72-83d3-0b3ead610138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:40 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Volume 95864e19-68bc-4153-81d9-a12f4fc9d32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95864e19-68bc-4153-81d9-a12f4fc9d32b', 'volume_size': 2}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-632132966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95864e19-68bc-4153-81d9-a12f4fc9d32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231b6546f9ba4dccb41484e0b8a73683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:40Z,use_quota=True,user_id='0cc69daacb304294b7b7b2de0fdd5e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Creating volume 95864e19-68bc-4153-81d9-a12f4fc9d32b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:40 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b 2147483648 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-quobyte-52e907cc-aae8-4c8a-8959-9fc088c1c20e" released by "_delete_snapshot" :: held 3.008s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-quobyte-134001e7-85b4-4f50-a921-6bdecbd0feea" released by "delete_snapshot" :: held 3.071s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:40 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b 2147483648
Sep 23 00:22:40 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Created reservations ['17898ceb-1c1b-45b2-b9fa-8110b368a191', 'b6e08575-2773-455f-b332-b8cdc15ce0dd', '65da5de2-6873-43fa-8a07-b2d238075b6b', '1a95f3b4-2104-46ff-aba6-799b30f921bf', '38119d5c-215e-442a-9729-2e6798903fb7'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:40 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Delete snapshot completed successfully.
Sep 23 00:22:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b62bd8d-1d0c-4d29-974d-1860d8340010 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-52e907cc-aae8-4c8a-8959-9fc088c1c20e-delete_snapshot" released by "delete_snapshot" :: held 3.424s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "cinder-134001e7-85b4-4f50-a921-6bdecbd0feea-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-134001e7-85b4-4f50-a921-6bdecbd0feea-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "cinder-quobyte-134001e7-85b4-4f50-a921-6bdecbd0feea" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-quobyte-134001e7-85b4-4f50-a921-6bdecbd0feea" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c53b18-3c01-4135-8ccb-b45823263864]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:41 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b 2147483648" returned: 0 in 1.056s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:41 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea
Sep 23 00:22:41 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:41 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b
Sep 23 00:22:41 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:41 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b" returned: 0 in 0.300s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f0ad2-258b-4b72-83d3-0b3ead610138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95864e19-68bc-4153-81d9-a12f4fc9d32b', 'volume_size': 2}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03554c95-6b2a-48f1-91e7-fa165c018a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:41 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Volume volume-95864e19-68bc-4153-81d9-a12f4fc9d32b (95864e19-68bc-4153-81d9-a12f4fc9d32b): created successfully
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03554c95-6b2a-48f1-91e7-fa165c018a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:41 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Flow 'volume_create_manager' (24bf1ca4-7f95-4ff8-88a4-b8f83be7c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea" returned: 0 in 0.617s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-85068338-da98-45a2-86ec-f2fc360f63e3 tempest-VolumesCloneNegativeTest-1710446986 None] Created volume successfully.
Sep 23 00:22:42 devstack sudo[97600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea
Sep 23 00:22:42 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:42 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:42 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f" returned: 0 in 3.248s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_xnhi2ldkdevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:22:42 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Converted 112.00 MB image at 34.32 MB/s
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-134001e7-85b4-4f50-a921-6bdecbd0feea" returned: 0 in 0.490s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:42 devstack sudo[97603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 1G
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-quobyte-134001e7-85b4-4f50-a921-6bdecbd0feea" released by "delete_volume" :: held 1.237s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:42 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Created reservations ['bccfd8e4-9032-4fc1-92b9-3a5855ad0b1e', '367b151e-9896-4fcb-9c65-c642ec476317', 'b35a8ccd-7dfb-411a-b4a0-03cae88bd85d', '64da7142-37c3-48e1-ad77-582f802cfa45', '67e95516-6327-4ddf-8f99-fa1053eb860b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Acquiring lock "cinder-95864e19-68bc-4153-81d9-a12f4fc9d32b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "cinder-95864e19-68bc-4153-81d9-a12f4fc9d32b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:42 devstack sudo[97605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:42 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Acquiring lock "cinder-quobyte-95864e19-68bc-4153-81d9-a12f4fc9d32b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "cinder-quobyte-95864e19-68bc-4153-81d9-a12f4fc9d32b" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93b7e56-9d29-4756-833c-ad2c19800f5e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Flow 'volume_create_manager' (42aa3a24-2128-4008-9df1-5178f577ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6fe7e2-2aeb-4c11-82c7-c31768192c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6fe7e2-2aeb-4c11-82c7-c31768192c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2013085418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3457c09-7d62-4693-8239-31e199031401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650e59ac5bd2474eb8ee41096877b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:43Z,use_quota=True,user_id='8a7759274bd14508bcd2a4ad02166cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf3dc1-d84b-446d-b86c-cd83ae2f45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:43 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf3dc1-d84b-446d-b86c-cd83ae2f45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:43 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:43 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da418a9-b3ff-4302-a516-18c52778ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da418a9-b3ff-4302-a516-18c52778ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3457c09-7d62-4693-8239-31e199031401', 'volume_name': 'volume-b3457c09-7d62-4693-8239-31e199031401', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dae2475-9b59-4a3b-af10-bb92335c4bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dae2475-9b59-4a3b-af10-bb92335c4bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b77e660-db9e-4f97-b8af-d94c29ce83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Volume b3457c09-7d62-4693-8239-31e199031401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3457c09-7d62-4693-8239-31e199031401', 'volume_size': 1}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2013085418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3457c09-7d62-4693-8239-31e199031401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650e59ac5bd2474eb8ee41096877b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:43Z,use_quota=True,user_id='8a7759274bd14508bcd2a4ad02166cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Creating volume b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:43 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:43 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.349s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 1G" returned: 0 in 0.686s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Downloaded image d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 5d4af2d4-2826-48e5-b361-869b3544f80f successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c for user 47a773e495f04f5cacc94d257eeaa05f is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Marking volume 5d4af2d4-2826-48e5-b361-869b3544f80f as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:22:43 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 1073741824
Sep 23 00:22:43 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Deleted volume successfully.
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Copying metadata from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c to 5d4af2d4-2826-48e5-b361-869b3544f80f. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Creating volume glance metadata for volume 5d4af2d4-2826-48e5-b361-869b3544f80f backed by image d3316061-b3c0-4b6e-8b31-c56fbf284d8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9f5ca24d-d9db-4875-b7e8-d528c7c548d7 tempest-SnapshotMetadataTestJSON-1848953743 None] Lock "cinder-134001e7-85b4-4f50-a921-6bdecbd0feea-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d6397a-9ec5-481b-9461-e5dedaea53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4af2d4-2826-48e5-b361-869b3544f80f', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4c464e0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b44525-c163-452f-ad85-39092d108772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Volume volume-5d4af2d4-2826-48e5-b361-869b3544f80f (5d4af2d4-2826-48e5-b361-869b3544f80f): created successfully
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b44525-c163-452f-ad85-39092d108772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Flow 'volume_create_manager' (6d666a4c-9313-4780-89b0-370d1e9f8482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-653b8925-3514-4624-a69e-7c0ca22d52a4 tempest-VolumesExtendTest-1101776839 None] Created volume successfully.
Sep 23 00:22:43 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b" returned: 0 in 0.498s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:43 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b
Sep 23 00:22:43 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:43 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 1073741824" returned: 0 in 0.534s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:43 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-95864e19-68bc-4153-81d9-a12f4fc9d32b" returned: 0 in 0.302s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:43 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:22:43 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "cinder-quobyte-95864e19-68bc-4153-81d9-a12f4fc9d32b" released by "delete_volume" :: held 0.874s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Created reservations ['00c94edf-5d18-462a-8d9d-c73b2a1fcf49', 'fefe100f-0eda-435a-92c1-1e2e22acc612', 'cbed25ff-ea34-45b8-bbc0-701d45ce8fc2', 'cbdc9f9a-aefa-4506-a308-6c9a0ca0a100', '9646a3a4-ce69-4973-954c-c35ed80ea584'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:44 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:44 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:44 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.457s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.046s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b77e660-db9e-4f97-b8af-d94c29ce83c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3457c09-7d62-4693-8239-31e199031401', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17aacd7c-b394-41d9-b826-a19b8e021d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e94975-0fa9-4655-a7a0-a7e53851b541]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:44 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Volume volume-b3457c09-7d62-4693-8239-31e199031401 (b3457c09-7d62-4693-8239-31e199031401): created successfully
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17aacd7c-b394-41d9-b826-a19b8e021d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Flow 'volume_create_manager' (42aa3a24-2128-4008-9df1-5178f577ad93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8735dda6-5df3-475a-8d9b-364b6c199282 tempest-VolumesActionsTest-545296814 None] Created volume successfully.
Sep 23 00:22:44 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.330s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Deleted volume successfully.
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae117df4-7a15-42f9-959e-ca2436642db2 tempest-VolumesCloneNegativeTest-1710446986 None] Lock "cinder-95864e19-68bc-4153-81d9-a12f4fc9d32b-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:44 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f
Sep 23 00:22:44 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:44 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f" returned: 0 in 0.476s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 2G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f 2G" returned: 0 in 0.122s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.634s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-631f6804-65fe-4609-9e56-062a24dd0ef8 tempest-VolumesExtendTest-1101776839 None] Extend volume completed successfully.
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-5d4af2d4-2826-48e5-b361-869b3544f80f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Lock "cinder-5d4af2d4-2826-48e5-b361-869b3544f80f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-quobyte-5d4af2d4-2826-48e5-b361-869b3544f80f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-5d4af2d4-2826-48e5-b361-869b3544f80f" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d2845c-5934-476c-833d-b796f062e261]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:46 devstack sudo[97639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f
Sep 23 00:22:46 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:46 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f" returned: 0 in 0.605s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:46 devstack sudo[97644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f
Sep 23 00:22:46 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:47 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5d4af2d4-2826-48e5-b361-869b3544f80f" returned: 0 in 0.494s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-5d4af2d4-2826-48e5-b361-869b3544f80f" released by "delete_volume" :: held 1.187s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Created reservations ['0136abcf-4118-4496-b4ba-1cd59b5a1944', 'b96f3be9-c8e0-4b48-9db4-1595ab15b1a6', 'ae15fe5b-0bb9-4d7b-91dc-35f3b9786a7e', '097e2ec8-ceeb-4435-ae2e-3aac78e7171d', '8e92e3e5-f841-4e7f-8108-5236b5b61a42'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:47 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:22:47 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:48 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Deleted volume successfully.
Sep 23 00:22:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5331020b-d77a-45b1-986b-782ec60b58f4 tempest-VolumesExtendTest-1101776839 None] Lock "cinder-5d4af2d4-2826-48e5-b361-869b3544f80f-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Flow 'volume_create_manager' (0f79a8ed-0bed-4f82-a7ac-eae4a57e9792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f671479-e603-439d-b846-31caeee78e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f671479-e603-439d-b846-31caeee78e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1924196254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584e78ce-9509-48bb-b5cb-e6d10d20bac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f66b4544d84127b6c33149081ad33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:49Z,use_quota=True,user_id='47a773e495f04f5cacc94d257eeaa05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d95613-298a-48d0-b172-5237cb902cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d95613-298a-48d0-b172-5237cb902cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dd42d5-c348-445a-9e1f-f7388bfb5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dd42d5-c348-445a-9e1f-f7388bfb5445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584e78ce-9509-48bb-b5cb-e6d10d20bac9', 'volume_name': 'volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73ea071-b0c5-4fc5-a2e3-4f3166b9ff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73ea071-b0c5-4fc5-a2e3-4f3166b9ff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c387575d-50ea-43bc-9890-adefe7b96c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Volume 584e78ce-9509-48bb-b5cb-e6d10d20bac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9', 'volume_size': 1}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1924196254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584e78ce-9509-48bb-b5cb-e6d10d20bac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f66b4544d84127b6c33149081ad33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:49Z,use_quota=True,user_id='47a773e495f04f5cacc94d257eeaa05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Creating volume 584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:49 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:49 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 1073741824
Sep 23 00:22:49 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:50 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 1073741824" returned: 0 in 0.784s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:50 devstack sudo[97670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9
Sep 23 00:22:50 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:50 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9" returned: 0 in 0.311s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c387575d-50ea-43bc-9890-adefe7b96c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dc3ff9-7265-42b4-afd8-806007740ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:50 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Volume volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 (584e78ce-9509-48bb-b5cb-e6d10d20bac9): created successfully
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dc3ff9-7265-42b4-afd8-806007740ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Flow 'volume_create_manager' (0f79a8ed-0bed-4f82-a7ac-eae4a57e9792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1fd660fd-b735-42a6-bd9d-4ef4bd42ec4e tempest-VolumesExtendTest-1101776839 None] Created volume successfully.
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Creating offline snapshot ba9dee66-5340-48c9-8a57-8408dad1dee1 of volume 584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Flow 'volume_create_manager' (0dedf11b-b387-4dd6-8260-d61ae4e45972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572fb718-f473-4782-b499-f43114fa2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b912ff1-25af-4529-b677-55aa94dd6a56]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Flow 'volume_create_manager' (2719507f-fdd7-4f35-936f-6af1cb1f0de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbdfbd9-6991-4cfc-821a-0803ecd0ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572fb718-f473-4782-b499-f43114fa2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1207557319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707e39f2-9a2f-4c20-93c1-43b8f947fd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8411166f3ea4fab9432e454a8e5ca7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:52Z,use_quota=True,user_id='af291e0b9d8a48ea9c5791bf367c7eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00667146-222e-4013-a627-a4485b77a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00667146-222e-4013-a627-a4485b77a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c703084-cda9-4f81-8969-ceea891c54c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c703084-cda9-4f81-8969-ceea891c54c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707e39f2-9a2f-4c20-93c1-43b8f947fd86', 'volume_name': 'volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9852771c-134a-4825-ab71-547ed2c8c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9852771c-134a-4825-ab71-547ed2c8c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71f3dbd-c87e-403a-af85-0ada233cc3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Volume 707e39f2-9a2f-4c20-93c1-43b8f947fd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86', 'volume_size': 1}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbdfbd9-6991-4cfc-821a-0803ecd0ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-448435760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b5bc1020049ea9753cf491d8e78ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:52Z,use_quota=True,user_id='4fbfc7b93885497592f10e2b472872c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9
Sep 23 00:22:52 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22458a3a-ff10-4cd6-8a5b-7eefe8e39149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22458a3a-ff10-4cd6-8a5b-7eefe8e39149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd303c8b-0fd8-49d4-a272-08bb64b84422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd303c8b-0fd8-49d4-a272-08bb64b84422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5', 'volume_name': 'volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c54646-a265-4952-95d5-86596997f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c54646-a265-4952-95d5-86596997f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07623a75-d667-4d02-8e7c-7219b8f4eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Volume c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5', 'volume_size': 1}
Sep 23 00:22:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:53 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:53 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 1G
Sep 23 00:22:53 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:53 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 1G" returned: 0 in 0.611s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:53 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1
Sep 23 00:22:53 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:54 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:54 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 is being set with open permissions: ugo+rw
Sep 23 00:22:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:54 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1
Sep 23 00:22:54 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:54 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1" returned: 0 in 0.579s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:54 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info
Sep 23 00:22:54 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:55 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info" returned: 0 in 0.504s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:55 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info is being set with open permissions: ugo+rw
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:55 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info
Sep 23 00:22:55 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:55 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.info" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1207557319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707e39f2-9a2f-4c20-93c1-43b8f947fd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8411166f3ea4fab9432e454a8e5ca7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:52Z,use_quota=True,user_id='af291e0b9d8a48ea9c5791bf367c7eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Creating volume 707e39f2-9a2f-4c20-93c1-43b8f947fd86 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:55 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:55 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 1073741824
Sep 23 00:22:55 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-12e96405-4db9-4e5e-a70c-9beeec94512c tempest-VolumesExtendTest-1101776839 None] Create snapshot completed successfully
Sep 23 00:22:56 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 1073741824" returned: 0 in 0.627s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:56 devstack sudo[97785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86
Sep 23 00:22:56 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:56 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86" returned: 0 in 0.323s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.922s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-448435760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b5bc1020049ea9753cf491d8e78ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:52Z,use_quota=True,user_id='4fbfc7b93885497592f10e2b472872c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Creating volume c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:56 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71f3dbd-c87e-403a-af85-0ada233cc3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5c809f-82b3-477c-a904-0566d5b4073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:56 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 1073741824
Sep 23 00:22:56 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:56 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Volume volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 (707e39f2-9a2f-4c20-93c1-43b8f947fd86): created successfully
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5c809f-82b3-477c-a904-0566d5b4073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Flow 'volume_create_manager' (0dedf11b-b387-4dd6-8260-d61ae4e45972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:56 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-567b332f-de4c-457a-8beb-d6101015ebd2 tempest-VolumesNegativeTest-1214572990 None] Created volume successfully.
Sep 23 00:22:57 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 1073741824" returned: 0 in 0.676s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:57 devstack sudo[97794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5
Sep 23 00:22:57 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fe089a2d-dc37-4e7b-b77e-dc01516e0fa9 tempest-VolumesActionsTest-545296814 None] Acquiring lock "cinder-b3457c09-7d62-4693-8239-31e199031401" by "attach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fe089a2d-dc37-4e7b-b77e-dc01516e0fa9 tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401" acquired by "attach_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:57 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5" returned: 0 in 0.456s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.097s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fe089a2d-dc37-4e7b-b77e-dc01516e0fa9 tempest-VolumesActionsTest-545296814 None] Attaching volume b3457c09-7d62-4693-8239-31e199031401 to instance c36b6a03-0bbc-4572-8497-d79faa2dd8a3 at mountpoint /dev/vdb on host None.
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47187b2-88e2-4be5-bf4a-4220687e0541]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07623a75-d667-4d02-8e7c-7219b8f4eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a211b7-938a-4bdb-aa72-c93e79d41b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fe089a2d-dc37-4e7b-b77e-dc01516e0fa9 tempest-VolumesActionsTest-545296814 None] Attach volume completed successfully.
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fe089a2d-dc37-4e7b-b77e-dc01516e0fa9 tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401" released by "attach_volume" :: held 0.230s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Volume volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 (c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5): created successfully
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a211b7-938a-4bdb-aa72-c93e79d41b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Flow 'volume_create_manager' (2719507f-fdd7-4f35-936f-6af1cb1f0de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6eea3269-1b46-472c-9663-c32493b20087 tempest-AbsoluteLimitsTests-656343957 None] Created volume successfully.
Sep 23 00:22:58 devstack sudo[97797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9
Sep 23 00:22:58 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1564663c-d13b-4559-a545-db80e8ad407a tempest-VolumesActionsTest-545296814 None] Acquiring lock "cinder-b3457c09-7d62-4693-8239-31e199031401-detach_volume" by "detach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1564663c-d13b-4559-a545-db80e8ad407a tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1564663c-d13b-4559-a545-db80e8ad407a tempest-VolumesActionsTest-545296814 None] Detaching volume b3457c09-7d62-4693-8239-31e199031401 from instance c36b6a03-0bbc-4572-8497-d79faa2dd8a3.
Sep 23 00:22:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1564663c-d13b-4559-a545-db80e8ad407a tempest-VolumesActionsTest-545296814 None] Detach volume completed successfully.
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1564663c-d13b-4559-a545-db80e8ad407a tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:58 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9" returned: 0 in 0.684s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 2G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 2G" returned: 0 in 0.333s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.119s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Acquiring lock "cinder-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-898956fe-0f13-46ce-bf9c-b6a70de861f4 tempest-VolumesExtendTest-1101776839 None] Extend volume completed successfully.
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Lock "cinder-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Acquiring lock "cinder-quobyte-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Lock "cinder-quobyte-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b28644-65c6-4284-8dfd-cd8ef3a0b6c9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:59 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5
Sep 23 00:22:59 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:00 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5" returned: 0 in 0.662s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:00 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5
Sep 23 00:23:00 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:00 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-ba9dee66-5340-48c9-8a57-8408dad1dee1-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5" returned: 0 in 0.413s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Lock "cinder-ba9dee66-5340-48c9-8a57-8408dad1dee1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-quobyte-584e78ce-9509-48bb-b5cb-e6d10d20bac9" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Lock "cinder-quobyte-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5" released by "delete_volume" :: held 1.170s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-584e78ce-9509-48bb-b5cb-e6d10d20bac9" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-quobyte-ba9dee66-5340-48c9-8a57-8408dad1dee1" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-ba9dee66-5340-48c9-8a57-8408dad1dee1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Deleting offline snapshot ba9dee66-5340-48c9-8a57-8408dad1dee1 of volume 584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] snapshot_file for this snap is: volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[252116b2-f58b-43f6-811b-d48ce321e2e9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Created reservations ['98b45597-13b4-45b4-a572-4ffdf581ef7e', '2bfa0853-ea01-447d-98b8-7a182965a997', '8af5dbce-b27c-4f91-8baf-4bbbb4dbae8c', '25688bda-4b73-46ae-9839-f2acf0092916', '1f8887a1-bef0-407f-8177-ecca2c1b4c33'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:00 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1
Sep 23 00:23:00 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:00 devstack sudo[97842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:23:00 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:01 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.516s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Deleted volume successfully.
Sep 23 00:23:01 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-56b9b1c7-2422-41d8-a6d4-8f03020b0da6 tempest-AbsoluteLimitsTests-656343957 None] Lock "cinder-c98b3bb9-ef7a-4c2c-b92c-d8f2bbd92fa5-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1" returned: 0 in 0.786s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194dcd6-5d8e-4da1-aac2-61535fef2c63]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:01 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9
Sep 23 00:23:01 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:02 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9" returned: 0 in 0.873s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:02 devstack sudo[97871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1
Sep 23 00:23:02 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:03 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1" returned: 0 in 0.724s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:03 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1
Sep 23 00:23:03 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:03 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9.ba9dee66-5340-48c9-8a57-8408dad1dee1" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-ba9dee66-5340-48c9-8a57-8408dad1dee1" released by "_delete_snapshot" :: held 3.011s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-584e78ce-9509-48bb-b5cb-e6d10d20bac9" released by "delete_snapshot" :: held 3.050s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Created reservations ['1c956217-8b27-445a-949a-158f0447fc6c', '14be9054-c8e8-481b-a7b7-7697e660d069', 'cf17a2bd-5d59-4ba6-9165-6cef8ef2dedb', '67977089-e325-4ec8-8055-09d842118952', '85e3657b-6e2c-40e5-a262-47ac21906521'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Delete snapshot completed successfully.
Sep 23 00:23:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-711906bc-d0df-451d-ad39-5d53cb686c0e tempest-VolumesExtendTest-1101776839 None] Lock "cinder-ba9dee66-5340-48c9-8a57-8408dad1dee1-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-584e78ce-9509-48bb-b5cb-e6d10d20bac9-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Lock "cinder-584e78ce-9509-48bb-b5cb-e6d10d20bac9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Acquiring lock "cinder-quobyte-584e78ce-9509-48bb-b5cb-e6d10d20bac9" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-584e78ce-9509-48bb-b5cb-e6d10d20bac9" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[953023b5-0ed5-46e7-a7d1-681d312b0f9a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:05 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9
Sep 23 00:23:05 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:05 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9" returned: 0 in 0.595s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:05 devstack sudo[97888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9
Sep 23 00:23:05 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:06 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-584e78ce-9509-48bb-b5cb-e6d10d20bac9" returned: 0 in 0.348s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Lock "cinder-quobyte-584e78ce-9509-48bb-b5cb-e6d10d20bac9" released by "delete_volume" :: held 1.040s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Created reservations ['30d0d0d5-5d67-4f98-93ae-8a9847db9123', '2d48eadd-a09c-4425-b44e-a2e347d06e16', '56abf8f8-a4f2-4e57-ba82-1efc244b4ea2', '8127e40a-e7d7-49a9-87f5-ca9d18f9cb71', 'a7ac3da3-8c08-4554-bc02-1b57c394c53b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:06 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:23:06 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:07 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.752s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:07 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:07 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Deleted volume successfully.
Sep 23 00:23:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4a174218-12a8-4a72-bb62-cff00aad99ed tempest-VolumesExtendTest-1101776839 None] Lock "cinder-584e78ce-9509-48bb-b5cb-e6d10d20bac9-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Flow 'volume_create_manager' (c2358c93-74a0-432d-a87a-e230ac5e0b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c7bc16-4e2d-404f-aa42-1d03ab1345aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c7bc16-4e2d-404f-aa42-1d03ab1345aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2141228923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfe1960-404a-47ce-a913-fcdafdf80d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93151dcdc2d4ecda4ae47de61d497f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:13Z,use_quota=True,user_id='c51c7683539a402186c49e955d3b6231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687792a5-a48d-4590-a564-469fccada9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687792a5-a48d-4590-a564-469fccada9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb9b40d-2146-44d2-ab92-b42a48dcae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb9b40d-2146-44d2-ab92-b42a48dcae07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfe1960-404a-47ce-a913-fcdafdf80d25', 'volume_name': 'volume-ecfe1960-404a-47ce-a913-fcdafdf80d25', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec00ec18-35f6-40db-baf1-ef239d0b4677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec00ec18-35f6-40db-baf1-ef239d0b4677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430a3748-5698-4731-8a8d-f2bd500093c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:13 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Volume ecfe1960-404a-47ce-a913-fcdafdf80d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfe1960-404a-47ce-a913-fcdafdf80d25', 'volume_size': 1}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2141228923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfe1960-404a-47ce-a913-fcdafdf80d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93151dcdc2d4ecda4ae47de61d497f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:13Z,use_quota=True,user_id='c51c7683539a402186c49e955d3b6231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Creating volume ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:13 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:23:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:13 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 1073741824
Sep 23 00:23:13 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:14 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 1073741824" returned: 0 in 0.786s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:14 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25
Sep 23 00:23:14 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:15 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25" returned: 0 in 0.475s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430a3748-5698-4731-8a8d-f2bd500093c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfe1960-404a-47ce-a913-fcdafdf80d25', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d950e0a-bcda-44f1-867d-3c215d281d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Volume volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 (ecfe1960-404a-47ce-a913-fcdafdf80d25): created successfully
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d950e0a-bcda-44f1-867d-3c215d281d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Flow 'volume_create_manager' (c2358c93-74a0-432d-a87a-e230ac5e0b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-76eb91cd-7a54-4821-9d1a-4329489ae3df tempest-VolumesDeleteCascade-2020940631 None] Created volume successfully.
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Creating offline snapshot a69ccad6-387d-4fc5-a657-65a28fb8e461 of volume ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a489f-be33-4f1d-b6f2-5f8ea9745041]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:16 devstack sudo[98025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25
Sep 23 00:23:16 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:17 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25" returned: 0 in 1.366s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:17 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 1G
Sep 23 00:23:17 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:17 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Flow 'volume_create_manager' (8723beed-1a96-422b-b16f-1cdb064b95f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fa1bd6-a6a7-4a50-91a1-a0a075bb8c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fa1bd6-a6a7-4a50-91a1-a0a075bb8c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1490069108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226b5414-a752-4db1-8ba9-aac7091e8d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc4529b6b7d480eb7cf275b242b6cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='4cefc91033a543848371ddda29ac0a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6782e8b-f19a-4fd1-a4b7-c1f2fe31fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6782e8b-f19a-4fd1-a4b7-c1f2fe31fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2791591a-b808-4dd4-a7d8-849ae561991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2791591a-b808-4dd4-a7d8-849ae561991d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226b5414-a752-4db1-8ba9-aac7091e8d54', 'volume_name': 'volume-226b5414-a752-4db1-8ba9-aac7091e8d54', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45526bcb-2d54-4923-aa7e-43167e8bfde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45526bcb-2d54-4923-aa7e-43167e8bfde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a02c583-ce5d-42f4-a8e7-ac74235f193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Volume 226b5414-a752-4db1-8ba9-aac7091e8d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226b5414-a752-4db1-8ba9-aac7091e8d54', 'volume_size': 1}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:18 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 1G" returned: 0 in 1.300s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:18 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:18 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:19 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.600s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:19 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 is being set with open permissions: ugo+rw
Sep 23 00:23:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:19 devstack sudo[98149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:19 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:19 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.460s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:19 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info
Sep 23 00:23:19 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:20 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info" returned: 0 in 0.437s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:20 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info is being set with open permissions: ugo+rw
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:20 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info
Sep 23 00:23:20 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d6641be8-ca82-4b61-abf8-3f963b96ea34 tempest-VolumesActionsTest-545296814 None] Acquiring lock "cinder-b3457c09-7d62-4693-8239-31e199031401" by "attach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d6641be8-ca82-4b61-abf8-3f963b96ea34 tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401" acquired by "attach_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:20 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.info" returned: 0 in 0.367s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.702s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1490069108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226b5414-a752-4db1-8ba9-aac7091e8d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc4529b6b7d480eb7cf275b242b6cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='4cefc91033a543848371ddda29ac0a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Creating volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:20 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:20 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 1073741824
Sep 23 00:23:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d6641be8-ca82-4b61-abf8-3f963b96ea34 tempest-VolumesActionsTest-545296814 None] Attaching volume b3457c09-7d62-4693-8239-31e199031401 to instance c945ab8c-cd56-4030-a6ed-0a5b81339a2d at mountpoint /dev/vdb on host None.
Sep 23 00:23:20 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a4958a06-7730-4ba9-8468-69810663f0ed tempest-VolumesDeleteCascade-2020940631 None] Create snapshot completed successfully
Sep 23 00:23:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d6641be8-ca82-4b61-abf8-3f963b96ea34 tempest-VolumesActionsTest-545296814 None] Attach volume completed successfully.
Sep 23 00:23:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d6641be8-ca82-4b61-abf8-3f963b96ea34 tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401" released by "attach_volume" :: held 0.246s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-77013b41-de28-4db6-acf6-5d60fa62530f tempest-VolumesActionsTest-545296814 None] Acquiring lock "cinder-b3457c09-7d62-4693-8239-31e199031401-detach_volume" by "detach_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-77013b41-de28-4db6-acf6-5d60fa62530f tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-77013b41-de28-4db6-acf6-5d60fa62530f tempest-VolumesActionsTest-545296814 None] Detaching volume b3457c09-7d62-4693-8239-31e199031401 from instance c945ab8c-cd56-4030-a6ed-0a5b81339a2d.
Sep 23 00:23:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-77013b41-de28-4db6-acf6-5d60fa62530f tempest-VolumesActionsTest-545296814 None] Detach volume completed successfully.
Sep 23 00:23:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-77013b41-de28-4db6-acf6-5d60fa62530f tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:21 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 1073741824" returned: 0 in 1.085s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:21 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54
Sep 23 00:23:21 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:22 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54" returned: 0 in 0.542s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a02c583-ce5d-42f4-a8e7-ac74235f193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226b5414-a752-4db1-8ba9-aac7091e8d54', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bbe495-094d-42be-862b-d10e74c6654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Creating offline snapshot 84e47b76-8c99-46ac-999d-3eeb14f16652 of volume ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:22 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Volume volume-226b5414-a752-4db1-8ba9-aac7091e8d54 (226b5414-a752-4db1-8ba9-aac7091e8d54): created successfully
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bbe495-094d-42be-862b-d10e74c6654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Flow 'volume_create_manager' (8723beed-1a96-422b-b16f-1cdb064b95f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebde4d39-4cf3-49d5-8c04-cfa78e2b62d6]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-73401107-6f57-4f66-9f11-f7d86b3dd1f7 tempest-VolumesSnapshotListTestJSON-823688695 None] Created volume successfully.
Sep 23 00:23:22 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:22 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:23 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.842s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfe1960-404a-47ce-a913-fcdafdf80d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:23 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 1G
Sep 23 00:23:23 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:24 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 1G" returned: 0 in 1.050s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:24 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652
Sep 23 00:23:24 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:24 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652" returned: 0 in 0.448s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:24 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 is being set with open permissions: ugo+rw
Sep 23 00:23:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:24 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652
Sep 23 00:23:24 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:25 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652" returned: 0 in 0.336s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.600s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Creating offline snapshot 83adfde4-ee2b-4d78-a49c-154f080f2c55 of volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-62d774f0-81fb-42f3-a1ef-034394a13aba tempest-VolumesDeleteCascade-2020940631 None] Create snapshot completed successfully
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ca3493-0be2-4951-aed0-243350e9c238]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:25 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54
Sep 23 00:23:25 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:25 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:25 devstack sudo[98218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 1G
Sep 23 00:23:25 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-ecfe1960-404a-47ce-a913-fcdafdf80d25-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-ecfe1960-404a-47ce-a913-fcdafdf80d25-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Performing cascade delete. {{(pid=87293) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-84e47b76-8c99-46ac-999d-3eeb14f16652-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-84e47b76-8c99-46ac-999d-3eeb14f16652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-84e47b76-8c99-46ac-999d-3eeb14f16652" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-84e47b76-8c99-46ac-999d-3eeb14f16652" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Deleting offline snapshot 84e47b76-8c99-46ac-999d-3eeb14f16652 of volume ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] snapshot_file for this snap is: volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1fa90-e4ef-4579-b26f-310d9457812b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:26 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 1G" returned: 0 in 0.834s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:26 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652
Sep 23 00:23:26 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:26 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:23:26 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652" returned: 0 in 0.465s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfe1960-404a-47ce-a913-fcdafdf80d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:27 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c2983-b6df-45ab-936b-b4dd89af1e5c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 0.435s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:27 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 is being set with open permissions: ugo+rw
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:23:27 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:27 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack sudo[98241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info
Sep 23 00:23:27 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.625s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfe1960-404a-47ce-a913-fcdafdf80d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack sudo[98245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652
Sep 23 00:23:27 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:28 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info" returned: 0 in 0.387s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info is being set with open permissions: ugo+rw
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info
Sep 23 00:23:28 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652" returned: 0 in 0.478s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652
Sep 23 00:23:28 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.info" returned: 0 in 0.328s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.532s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280fb4c-e95a-4555-8bb8-6573c97fca56]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e1be72c-f593-428a-9fba-3742489c2098 tempest-VolumesSnapshotListTestJSON-823688695 None] Create snapshot completed successfully
Sep 23 00:23:28 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:23:28 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.84e47b76-8c99-46ac-999d-3eeb14f16652" returned: 0 in 0.437s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-84e47b76-8c99-46ac-999d-3eeb14f16652" released by "_delete_snapshot" :: held 2.170s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" released by "delete_snapshot" :: held 2.216s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Created reservations ['3427d2fe-68bb-4413-9ff9-946422f54b72', 'aaca40a1-dcbc-4d94-9a82-fb6600186e2c', '1d15033b-69f4-49c0-b1fa-832dcc0cb07b', '6112549b-64cc-42f1-bce7-f81b66c35b91', '032b5083-5022-4584-95ce-4c0819bd0211'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:28 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Delete snapshot completed successfully.
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.479s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-84e47b76-8c99-46ac-999d-3eeb14f16652-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-a69ccad6-387d-4fc5-a657-65a28fb8e461-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5032197-481f-4106-934c-ce08fc480f1d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-a69ccad6-387d-4fc5-a657-65a28fb8e461-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-a69ccad6-387d-4fc5-a657-65a28fb8e461" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-a69ccad6-387d-4fc5-a657-65a28fb8e461" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Deleting offline snapshot a69ccad6-387d-4fc5-a657-65a28fb8e461 of volume ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] snapshot_file for this snap is: volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0392cc-785b-42ef-a126-76974d9dc490]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:23:29 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Acquiring lock "cinder-707e39f2-9a2f-4c20-93c1-43b8f947fd86-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Lock "cinder-707e39f2-9a2f-4c20-93c1-43b8f947fd86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Acquiring lock "cinder-quobyte-707e39f2-9a2f-4c20-93c1-43b8f947fd86" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:29 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:29 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Lock "cinder-quobyte-707e39f2-9a2f-4c20-93c1-43b8f947fd86" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c0c83-21d1-44f6-989c-2e23e7596461]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack sudo[98267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86
Sep 23 00:23:29 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:29 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.618s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.44547759-e91d-4622-8dee-768ebe5697cb6cpumsyz.img {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack sudo[98274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.44547759-e91d-4622-8dee-768ebe5697cb6cpumsyz.img
Sep 23 00:23:29 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:29 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.589s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfe1960-404a-47ce-a913-fcdafdf80d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7bcb8f-f356-4ac0-8e90-521649dee9b9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25
Sep 23 00:23:29 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:29 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86" returned: 0 in 0.544s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack sudo[98290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86
Sep 23 00:23:29 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:30 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-707e39f2-9a2f-4c20-93c1-43b8f947fd86" returned: 0 in 0.485s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:30 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25" returned: 0 in 0.676s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Lock "cinder-quobyte-707e39f2-9a2f-4c20-93c1-43b8f947fd86" released by "delete_volume" :: held 1.140s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:30 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:30 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Created reservations ['8102a70a-4be1-445c-9a10-f2dd31e08f7a', 'ca66459b-a03b-4030-bda5-312a66ee7a95', '7fe3154b-8590-4346-b9ab-9c2339deb56e', 'ebbf449c-2654-4293-bce3-991e57bd183a', 'deaa7178-a2ed-4558-a907-240a2b4ed4e1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:30 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:23:30 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:31 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.968s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:31 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.557s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Deleted volume successfully.
Sep 23 00:23:31 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461
Sep 23 00:23:31 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45e01900-583d-4f29-b721-f034d0821768 tempest-VolumesNegativeTest-1214572990 None] Lock "cinder-707e39f2-9a2f-4c20-93c1-43b8f947fd86-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:31 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25.a69ccad6-387d-4fc5-a657-65a28fb8e461" returned: 0 in 0.421s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-a69ccad6-387d-4fc5-a657-65a28fb8e461" released by "_delete_snapshot" :: held 2.831s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" released by "delete_snapshot" :: held 2.872s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Created reservations ['14f06a89-65ae-4db4-9ad5-66a191be56bc', '119fff0b-4864-4b12-8679-370ca27ccfd7', '22c87aa1-f003-4c49-9bfe-7f3996908a26', 'a251347e-914c-4fe4-8e58-4b82a657ec93', 'd99e783d-440c-412d-8cd5-c02ea3a87748'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:32 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Delete snapshot completed successfully.
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-a69ccad6-387d-4fc5-a657-65a28fb8e461-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Snapshots deleted, issuing volume delete {{(pid=87293) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e026fa23-5e6d-4182-9448-a1fbadbdd4df]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:32 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25
Sep 23 00:23:32 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:33 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25" returned: 0 in 1.032s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:33 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25
Sep 23 00:23:33 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:34 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ecfe1960-404a-47ce-a913-fcdafdf80d25" returned: 0 in 0.681s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-ecfe1960-404a-47ce-a913-fcdafdf80d25" released by "delete_volume" :: held 1.898s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Created reservations ['d9cd17d4-ca87-4c79-83a2-6ccf5811090a', '9703f770-c4f9-4187-bbf9-7466ed06f20d', '4f13799b-c0df-497d-b482-3efdb689e233', 'b8eb290c-26e0-4c19-bfb7-dec2f57ad3ae', '13acd1d7-4668-412a-bca3-1fddb6846630'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:34 devstack sudo[98324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:23:34 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:35 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.869s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:35 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Deleted volume successfully.
Sep 23 00:23:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-775b7688-bc85-4f04-8a90-630654821a3f tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-ecfe1960-404a-47ce-a913-fcdafdf80d25-delete_volume" released by "delete_volume" :: held 9.464s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=140,cinder:SELECT=118,cinder:INSERT=43,cinder:DELETE=7 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Flow 'volume_create_manager' (fdf4e693-d6b8-461d-b271-0355123a885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40da7bd8-d3b0-4ef7-a7fe-617330ae575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40da7bd8-d3b0-4ef7-a7fe-617330ae575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-669814039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71be362c-af35-4c0a-a6b1-9fa40f1fdf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93151dcdc2d4ecda4ae47de61d497f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:38Z,use_quota=True,user_id='c51c7683539a402186c49e955d3b6231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8a277f-483d-4acd-b724-26b665e704f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8a277f-483d-4acd-b724-26b665e704f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0fb31f-14e7-4eff-8282-0bd7514ba4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0fb31f-14e7-4eff-8282-0bd7514ba4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71be362c-af35-4c0a-a6b1-9fa40f1fdf1c', 'volume_name': 'volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829e0aa8-3302-43a0-b953-5f3c84930e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829e0aa8-3302-43a0-b953-5f3c84930e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95655a9f-2015-4527-9f72-05d8ae3c1ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Volume 71be362c-af35-4c0a-a6b1-9fa40f1fdf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c', 'volume_size': 1}
Sep 23 00:23:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:39 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.44547759-e91d-4622-8dee-768ebe5697cb6cpumsyz.img" returned: 0 in 9.489s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8733d3cd-27f6-4561-8403-0a0607009e99]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:39 devstack sudo[98329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:23:39 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:39 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.752s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.44547759-e91d-4622-8dee-768ebe5697cb6cpumsyz.img {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:23:39 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Converted 1024.00 MB image at 107.90 MB/s
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] 44547759-e91d-4622-8dee-768ebe5697cb was raw, no need to convert to raw {{(pid=87293) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:39 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:23:39 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:40 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:23:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:23:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:23:49 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:23:49 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=123,cinder:INSERT=38,cinder:UPDATE=124,cinder:DELETE=12 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.414s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Uploaded volume to glance image-id: 44547759-e91d-4622-8dee-768ebe5697cb. {{(pid=87293) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 23 00:24:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 34.292s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Creating offline snapshot e4ff0e74-b052-426d-ba14-f519e2445253 of volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:24:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-40eb81a8-f14f-4125-a300-6c515aae0184 tempest-VolumesActionsTest-545296814 None] Copy volume to image completed successfully.
Sep 23 00:24:03 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd9787-4b52-4948-a451-617e376eb7db]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:04 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:24:04 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:04 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 0.507s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:04 devstack sudo[98351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 1G
Sep 23 00:24:04 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:05 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 1G" returned: 0 in 0.663s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:05 devstack sudo[98357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:05 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:05 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.371s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:05 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 is being set with open permissions: ugo+rw
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:05 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:05 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:05 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.351s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.155s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-669814039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71be362c-af35-4c0a-a6b1-9fa40f1fdf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93151dcdc2d4ecda4ae47de61d497f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:38Z,use_quota=True,user_id='c51c7683539a402186c49e955d3b6231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Creating volume 71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:05 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:05 devstack sudo[98365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c 1073741824
Sep 23 00:24:05 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e0edbf05-7484-4afd-a219-ef39ac136dfd tempest-VolumesSnapshotListTestJSON-823688695 None] Create snapshot completed successfully
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:06 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c 1073741824" returned: 0 in 0.531s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:06 devstack sudo[98371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c
Sep 23 00:24:06 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:06 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.799s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95655a9f-2015-4527-9f72-05d8ae3c1ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc49bda9-58d1-430a-8fad-ed5c2fd1cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c5455-6f68-48d8-9905-93927c16c09c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:06 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Volume volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c (71be362c-af35-4c0a-a6b1-9fa40f1fdf1c): created successfully
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc49bda9-58d1-430a-8fad-ed5c2fd1cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Flow 'volume_create_manager' (fdf4e693-d6b8-461d-b271-0355123a885a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:07 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-62908c7b-7cd5-43ee-b786-8dcc3539f098 tempest-VolumesDeleteCascade-2020940631 None] Created volume successfully.
Sep 23 00:24:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:07 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:24:07 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:07 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.522s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fc18a5-18b1-4b23-a7b8-b4689b47ed3d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:07 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:24:07 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:07 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.438s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:07 devstack sudo[98384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img
Sep 23 00:24:07 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:11 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Flow 'volume_create_manager' (2936f652-c91b-498f-be8a-ff03534bcb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2008ff-9d29-4a45-b39e-7c60a4a88341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2008ff-9d29-4a45-b39e-7c60a4a88341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2029370375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d70b82-ef8c-47a0-a3b9-ef4f0004b37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886e268f44e3465cb46a71644378283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:12Z,use_quota=True,user_id='9bb122ee44df4f62a0bd0d8d45af6fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84677658-3d96-4d80-8132-62c1b83cb258),volume_type_id=84677658-3d96-4d80-8132-62c1b83cb258)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9ce2c6-1a37-4e05-aed9-5e0bf27c97fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9ce2c6-1a37-4e05-aed9-5e0bf27c97fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d0b92b-78ab-4736-bbb5-4fd19f826b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d0b92b-78ab-4736-bbb5-4fd19f826b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d70b82-ef8c-47a0-a3b9-ef4f0004b37a', 'volume_name': 'volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9736d80b-2c51-4a6a-bbe8-9c4cead51635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9736d80b-2c51-4a6a-bbe8-9c4cead51635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f2463f-8681-46a9-85aa-8e3cd534fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume 33d70b82-ef8c-47a0-a3b9-ef4f0004b37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a', 'volume_size': 1}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:12 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Flow 'volume_create_manager' (ccd75413-f90f-4c45-af13-116dfc7c6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03903965-2d65-4498-b13f-d4222f65c27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03903965-2d65-4498-b13f-d4222f65c27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-249884755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d1bf35-39ac-41bd-b821-9a6bfcb300db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886e268f44e3465cb46a71644378283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:13Z,use_quota=True,user_id='9bb122ee44df4f62a0bd0d8d45af6fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643400a7-da9a-4996-ae4b-426f8ab12f1e),volume_type_id=643400a7-da9a-4996-ae4b-426f8ab12f1e)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28cf9e6-1628-441d-803f-87c33ebc8326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28cf9e6-1628-441d-803f-87c33ebc8326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07e7ec2-a384-4b1e-9fb6-365229066e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07e7ec2-a384-4b1e-9fb6-365229066e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d1bf35-39ac-41bd-b821-9a6bfcb300db', 'volume_name': 'volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6718c-9ce7-44b4-be29-1b1e759dcd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6718c-9ce7-44b4-be29-1b1e759dcd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa51830-8195-4ccb-86ae-4c81b539dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:13 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume d0d1bf35-39ac-41bd-b821-9a6bfcb300db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db', 'volume_size': 1}
Sep 23 00:24:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Flow 'volume_create_manager' (72016672-15ab-480f-95b9-890a55a13aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d29956-1db3-49ba-bb6b-ab8b3b0451b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d29956-1db3-49ba-bb6b-ab8b3b0451b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1028116614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cb6eb8-05db-4049-8b2f-97d06305dc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886e268f44e3465cb46a71644378283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:14Z,use_quota=True,user_id='9bb122ee44df4f62a0bd0d8d45af6fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31542c62-83fa-4b0d-914e-ffcf4aed105f),volume_type_id=31542c62-83fa-4b0d-914e-ffcf4aed105f)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4512cab6-e578-4080-a7d6-9819201212bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4512cab6-e578-4080-a7d6-9819201212bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf2f8c5-df34-407e-b22b-a1e11d64a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:14 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf2f8c5-df34-407e-b22b-a1e11d64a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98cb6eb8-05db-4049-8b2f-97d06305dc7a', 'volume_name': 'volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a', 'volume_size': 1, 'image_id': '56b87723-9036-473e-a3ba-d44e38283463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56b87723-9036-473e-a3ba-d44e38283463', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1367787808', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '886e268f44e3465cb46a71644378283a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '56b87723-9036-473e-a3ba-d44e38283463', 'created_at': datetime.datetime(2026, 9, 22, 22, 24, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 24, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56b87723-9036-473e-a3ba-d44e38283463/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf08b230>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3525724b-9659-4d20-ba61-592660d25f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3525724b-9659-4d20-ba61-592660d25f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b4ebbe-9bd1-4d66-9b5c-ff7bc51534e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume 98cb6eb8-05db-4049-8b2f-97d06305dc7a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a', 'volume_size': 1, 'image_id': '56b87723-9036-473e-a3ba-d44e38283463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56b87723-9036-473e-a3ba-d44e38283463', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1367787808', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '886e268f44e3465cb46a71644378283a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '56b87723-9036-473e-a3ba-d44e38283463', 'created_at': datetime.datetime(2026, 9, 22, 22, 24, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 24, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56b87723-9036-473e-a3ba-d44e38283463/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf08b230>}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Trying to clone 98cb6eb8-05db-4049-8b2f-97d06305dc7a from image 56b87723-9036-473e-a3ba-d44e38283463 at location (None, [{'url': 'file:///opt/stack/data/glance/images/56b87723-9036-473e-a3ba-d44e38283463', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:24:15 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img" returned: 0 in 7.884s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565bc08-3954-4445-9664-4ce7032a74c0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:15 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:24:15 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:16 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.581s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:24:16 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Converted 1024.00 MB image at 129.87 MB/s
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] a0c7d3eb-521d-4305-9575-0feb72822070 was raw, converting to qcow2 {{(pid=87293) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63471e8-0e65-4755-af10-5cac6e8dff14]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:16 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img
Sep 23 00:24:16 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:16 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img" returned: 0 in 0.432s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:16 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img
Sep 23 00:24:16 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:17 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img" returned: 1 in 0.393s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img /opt/stack/data/cinder/conversion/vol_upload_azik1q6n {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:17 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img /opt/stack/data/cinder/conversion/vol_upload_azik1q6n
Sep 23 00:24:17 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:17 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img /opt/stack/data/cinder/conversion/vol_upload_azik1q6n" returned: 0 in 0.290s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Image conversion details: src /opt/stack/data/cinder/conversion/b3457c09-7d62-4693-8239-31e199031401.temp_image.a0c7d3eb-521d-4305-9575-0feb7282207057euddn7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_azik1q6n {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:24:17 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f04ab7-5de6-479e-bd25-724b5cdef28c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_azik1q6n {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:17 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_azik1q6n
Sep 23 00:24:17 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:17 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_azik1q6n" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:18 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD, size 20.69 MB, duration 3.85 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:24:18 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Image download 20.69 MB at 5.38 MB/s
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d831bc5c-05ce-4e45-ad10-ceb381005d38]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:19 devstack sudo[98464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD
Sep 23 00:24:19 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:19 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Temporary image 56b87723-9036-473e-a3ba-d44e38283463 is fetched for user 9bb122ee44df4f62a0bd0d8d45af6fab. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45635f-65e1-429b-a9fe-8b9cfcc64a58]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.763s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Uploaded volume to glance image-id: a0c7d3eb-521d-4305-9575-0feb72822070. {{(pid=87293) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.619s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Creating offline snapshot 1e9625c6-ca88-4e09-add1-471d1e0c38cb of volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:24:19 devstack sudo[98469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD
Sep 23 00:24:19 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fa393d4e-24ea-41cd-8409-56de6c4afaa9 tempest-VolumesActionsTest-545296814 None] Copy volume to image completed successfully.
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eccc57-8f57-4447-84a9-8d7ad536830f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:19 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:19 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:20 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:20 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.527s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:20 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb 1G
Sep 23 00:24:20 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Acquiring lock "cinder-b3457c09-7d62-4693-8239-31e199031401-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Acquiring lock "cinder-quobyte-b3457c09-7d62-4693-8239-31e199031401" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Lock "cinder-quobyte-b3457c09-7d62-4693-8239-31e199031401" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa45e9d-9a44-42a6-9365-0098fc160356]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:20 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb 1G" returned: 0 in 0.680s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:21 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb
Sep 23 00:24:21 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:21 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:24:21 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:21 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb" returned: 0 in 0.449s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:21 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb is being set with open permissions: ugo+rw
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:21 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb
Sep 23 00:24:21 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:21 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.515s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:21 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401
Sep 23 00:24:21 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:21 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb" returned: 0 in 0.302s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:21 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.563s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b3457c09-7d62-4693-8239-31e199031401" returned: 0 in 0.313s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Creating offline snapshot 89e9cf4f-f99d-4e37-b778-689cac6e9635 of volume 71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Lock "cinder-quobyte-b3457c09-7d62-4693-8239-31e199031401" released by "delete_volume" :: held 0.901s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8166b880-d8b2-465d-9e24-7dfeeff93d03]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ec11216c-0695-4175-a365-b584fd45fcdb tempest-VolumesSnapshotListTestJSON-823688695 None] Create snapshot completed successfully
Sep 23 00:24:21 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Created reservations ['db4d3e07-a03d-4b5a-9338-761a658df90b', '3e3f05fc-3380-4983-85af-c83b9a19cc9e', '335e05a9-7295-470b-9ce0-d71feebb948b', 'd2315471-7b42-418c-a0eb-732ad8b8f5f3', '3d62e823-fa36-4f15-a405-c385bed82366'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:22 devstack sudo[98502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c
Sep 23 00:24:22 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:22 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:24:22 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:22 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" returned: 0 in 0.576s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:22 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.357s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:22 devstack sudo[98510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 1G
Sep 23 00:24:22 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Deleted volume successfully.
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-83b851ca-af9b-4c39-98f1-0435397721ab tempest-VolumesActionsTest-545296814 None] Lock "cinder-b3457c09-7d62-4693-8239-31e199031401-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:22 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 1G" returned: 0 in 0.552s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:22 devstack sudo[98516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635
Sep 23 00:24:22 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-1e9625c6-ca88-4e09-add1-471d1e0c38cb-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-1e9625c6-ca88-4e09-add1-471d1e0c38cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-1e9625c6-ca88-4e09-add1-471d1e0c38cb" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-1e9625c6-ca88-4e09-add1-471d1e0c38cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Deleting offline snapshot 1e9625c6-ca88-4e09-add1-471d1e0c38cb of volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] snapshot_file for this snap is: volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[450923c9-2178-4c09-a006-9fd6422d7c75]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:23 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:23 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 is being set with open permissions: ugo+rw
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:23 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635
Sep 23 00:24:23 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:23 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb
Sep 23 00:24:23 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:23 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635" returned: 0 in 0.294s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:23 devstack sudo[98528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info
Sep 23 00:24:23 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:23 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb" returned: 0 in 0.446s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[71edbed8-b83f-4948-8263-d21e02f23e5f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:24 devstack sudo[98531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:24 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:24 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info" returned: 0 in 0.341s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:24 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info is being set with open permissions: ugo+rw
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:24 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info
Sep 23 00:24:24 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:24 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.info" returned: 0 in 0.384s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:24 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.436s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2029370375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d70b82-ef8c-47a0-a3b9-ef4f0004b37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886e268f44e3465cb46a71644378283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:12Z,use_quota=True,user_id='9bb122ee44df4f62a0bd0d8d45af6fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84677658-3d96-4d80-8132-62c1b83cb258),volume_type_id=84677658-3d96-4d80-8132-62c1b83cb258)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Creating volume 33d70b82-ef8c-47a0-a3b9-ef4f0004b37a {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:24 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.650s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:24 devstack sudo[98540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a 1073741824
Sep 23 00:24:24 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:24 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d2659834-31e0-4b9b-bf83-27cbe0506f78 tempest-VolumesDeleteCascade-2020940631 None] Create snapshot completed successfully
Sep 23 00:24:24 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb
Sep 23 00:24:24 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:25 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb" returned: 0 in 0.498s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:25 devstack sudo[98552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb
Sep 23 00:24:25 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:25 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a 1073741824" returned: 0 in 0.570s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:25 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a
Sep 23 00:24:25 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:25 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.1e9625c6-ca88-4e09-add1-471d1e0c38cb" returned: 0 in 0.424s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-1e9625c6-ca88-4e09-add1-471d1e0c38cb" released by "_delete_snapshot" :: held 2.184s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" released by "delete_snapshot" :: held 2.216s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:25 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a" returned: 0 in 0.462s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.421s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-249884755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d1bf35-39ac-41bd-b821-9a6bfcb300db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886e268f44e3465cb46a71644378283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:13Z,use_quota=True,user_id='9bb122ee44df4f62a0bd0d8d45af6fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643400a7-da9a-4996-ae4b-426f8ab12f1e),volume_type_id=643400a7-da9a-4996-ae4b-426f8ab12f1e)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Creating volume d0d1bf35-39ac-41bd-b821-9a6bfcb300db {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:25 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:25 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db 1073741824
Sep 23 00:24:25 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f2463f-8681-46a9-85aa-8e3cd534fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45956be-7686-46cb-a1af-e56e612fdafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:25 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a (33d70b82-ef8c-47a0-a3b9-ef4f0004b37a): created successfully
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45956be-7686-46cb-a1af-e56e612fdafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Flow 'volume_create_manager' (2936f652-c91b-498f-be8a-ff03534bcb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Created reservations ['92bff353-c8b7-49c4-88e5-3a5cefcda160', '0d0193f3-4f14-4d90-8d57-0066e969c708', 'fea8b840-aab2-443e-b9ed-866b0a84d52c', '29615b5e-7be0-44fd-850d-8bc1dd917e05', '4ac526de-5998-48ad-b74d-bd2aeeebcdab'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f4fbcea5-48f0-44a6-8aa7-ad937800529a tempest-TestInstancesWithCinderVolumes-1048714199 None] Created volume successfully.
Sep 23 00:24:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Delete snapshot completed successfully.
Sep 23 00:24:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6e792eb9-6e78-483b-aa00-ad01ad4bbcf0 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-1e9625c6-ca88-4e09-add1-471d1e0c38cb-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:26 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db 1073741824" returned: 0 in 0.704s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:26 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db
Sep 23 00:24:26 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Flow 'volume_create_manager' (f2ea214e-6d3a-405d-b3db-6f9b3cbba80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b070b48-5da8-4f14-a0bb-035f97d01695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b070b48-5da8-4f14-a0bb-035f97d01695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-183480940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad5b893-b884-4c60-9d4a-000e5aefe17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93151dcdc2d4ecda4ae47de61d497f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=89e9cf4f-f99d-4e37-b778-689cac6e9635,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:26Z,use_quota=True,user_id='c51c7683539a402186c49e955d3b6231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bd02f9-4d38-4d65-ba75-f1cb9b1d9eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bd02f9-4d38-4d65-ba75-f1cb9b1d9eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed7d972-26b6-4a74-bc0a-1a5e23b02b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed7d972-26b6-4a74-bc0a-1a5e23b02b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bad5b893-b884-4c60-9d4a-000e5aefe17d', 'volume_name': 'volume-bad5b893-b884-4c60-9d4a-000e5aefe17d', 'volume_size': 1, 'snapshot_id': '89e9cf4f-f99d-4e37-b778-689cac6e9635'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1e2d53-6f65-4872-9f56-effa3c3b9bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1e2d53-6f65-4872-9f56-effa3c3b9bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff635f19-8740-42d5-9f73-26080b234f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:26 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Volume bad5b893-b884-4c60-9d4a-000e5aefe17d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bad5b893-b884-4c60-9d4a-000e5aefe17d', 'volume_size': 1, 'snapshot_id': '89e9cf4f-f99d-4e37-b778-689cac6e9635'}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-e4ff0e74-b052-426d-ba14-f519e2445253-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-e4ff0e74-b052-426d-ba14-f519e2445253-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-e4ff0e74-b052-426d-ba14-f519e2445253" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-e4ff0e74-b052-426d-ba14-f519e2445253" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Deleting offline snapshot e4ff0e74-b052-426d-ba14-f519e2445253 of volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] snapshot_file for this snap is: volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31474a9-3117-4c5c-84ad-f2e52a35571d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:26 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db" returned: 0 in 0.320s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.603s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1028116614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cb6eb8-05db-4049-8b2f-97d06305dc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886e268f44e3465cb46a71644378283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:14Z,use_quota=True,user_id='9bb122ee44df4f62a0bd0d8d45af6fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31542c62-83fa-4b0d-914e-ffcf4aed105f),volume_type_id=31542c62-83fa-4b0d-914e-ffcf4aed105f)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Creating volume 98cb6eb8-05db-4049-8b2f-97d06305dc7a {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:26 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa51830-8195-4ccb-86ae-4c81b539dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:26 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a 1073741824
Sep 23 00:24:26 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d71753-49b6-466e-a720-645c2289eac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:26 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db (d0d1bf35-39ac-41bd-b821-9a6bfcb300db): created successfully
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d71753-49b6-466e-a720-645c2289eac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Flow 'volume_create_manager' (ccd75413-f90f-4c45-af13-116dfc7c6868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f0bae9aa-28d6-4c20-b93a-2ef5a689f689 tempest-TestInstancesWithCinderVolumes-1048714199 None] Created volume successfully.
Sep 23 00:24:26 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:26 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:27 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.535s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bcb6d3-a39f-41fa-9cda-75dbb499ae49]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:27 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a 1073741824" returned: 0 in 0.628s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:27 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:24:27 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:27 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a
Sep 23 00:24:27 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:27 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 0.413s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:27 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a" returned: 0 in 0.300s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:27 devstack sudo[98587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.142s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-89e9cf4f-f99d-4e37-b778-689cac6e9635-bad5b893-b884-4c60-9d4a-000e5aefe17d" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:27 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-89e9cf4f-f99d-4e37-b778-689cac6e9635-bad5b893-b884-4c60-9d4a-000e5aefe17d" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Creating volume bad5b893-b884-4c60-9d4a-000e5aefe17d from snapshot 89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-bad5b893-b884-4c60-9d4a-000e5aefe17d" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Attempting download of 56b87723-9036-473e-a3ba-d44e38283463 ((None, [{'url': 'file:///opt/stack/data/glance/images/56b87723-9036-473e-a3ba-d44e38283463', 'metadata': {}}])) to volume 98cb6eb8-05db-4049-8b2f-97d06305dc7a. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-bad5b893-b884-4c60-9d4a-000e5aefe17d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] snapshot: 89e9cf4f-f99d-4e37-b778-689cac6e9635, volume: bad5b893-b884-4c60-9d4a-000e5aefe17d,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[de736732-50b7-4de8-a316-9a0384c204a7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7498623e-efab-447d-94ad-602749fc0715]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:27 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635
Sep 23 00:24:27 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:28 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25
Sep 23 00:24:28 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:28 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.592s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:28 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253
Sep 23 00:24:28 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:28 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25" returned: 0 in 0.535s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:28 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635" returned: 0 in 0.598s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab09383-890a-4826-b91d-632d4a40e050]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:28 devstack sudo[98605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25
Sep 23 00:24:28 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:28 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.e4ff0e74-b052-426d-ba14-f519e2445253" returned: 0 in 0.324s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:28 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c
Sep 23 00:24:28 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-e4ff0e74-b052-426d-ba14-f519e2445253" released by "_delete_snapshot" :: held 2.004s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" released by "delete_snapshot" :: held 2.036s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Created reservations ['28b8ca5d-d857-4973-b944-7a9d9b7a98b8', 'e241cac1-bdab-467d-9ef5-65d9209817a0', 'e9591113-294d-456e-af84-b56afa9b2f3d', '0db7d059-805a-48b7-a895-e972b6df7cb4', '022d5c4f-ae07-4084-a9af-3fb442e6f958'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:28 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25" returned: 1 in 0.457s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56b87723-9036-473e-a3ba-d44e38283463_v_8_3b25' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30483f-9708-4700-b7f7-ae8a6dc31301]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:28 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Delete snapshot completed successfully.
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f016af70-b4d3-4e0c-b686-96eac00826c4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-e4ff0e74-b052-426d-ba14-f519e2445253-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:28 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" returned: 0 in 0.511s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:24:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:28 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD
Sep 23 00:24:28 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:28 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d
Sep 23 00:24:28 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:29 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:29 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] 56b87723-9036-473e-a3ba-d44e38283463 was qcow2, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:24:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:29 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a
Sep 23 00:24:29 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-83adfde4-ee2b-4d78-a49c-154f080f2c55-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-83adfde4-ee2b-4d78-a49c-154f080f2c55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-83adfde4-ee2b-4d78-a49c-154f080f2c55" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-83adfde4-ee2b-4d78-a49c-154f080f2c55" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Deleting offline snapshot 83adfde4-ee2b-4d78-a49c-154f080f2c55 of volume 226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] snapshot_file for this snap is: volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e9b43-96f2-44b8-993d-aff3d42b0c3e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:30 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:24:30 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:31 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 1.009s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226b5414-a752-4db1-8ba9-aac7091e8d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[043bf54c-0f5f-4e90-ad5d-e37fb6a145a8]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:31 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54
Sep 23 00:24:31 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:32 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54" returned: 0 in 0.969s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:32 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:24:32 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:33 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 0.938s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:33 devstack sudo[98662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55
Sep 23 00:24:33 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:33 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54.83adfde4-ee2b-4d78-a49c-154f080f2c55" returned: 0 in 0.598s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-83adfde4-ee2b-4d78-a49c-154f080f2c55" released by "_delete_snapshot" :: held 3.864s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" released by "delete_snapshot" :: held 3.940s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:34 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Created reservations ['9e244755-ac61-404a-ac0d-dbcc60d0382e', '0b3a0578-e7b1-4cb4-85ef-620cb0eb24ac', '8547d51a-490f-444c-a566-d39d1d1b663d', '39e32583-a179-472f-9eeb-e3426cd11176', '2d7d6eda-b38d-45c5-807d-9e57a9d519b1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Delete snapshot completed successfully.
Sep 23 00:24:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-797bac5d-5f45-4114-8dee-b066051f00d4 tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-83adfde4-ee2b-4d78-a49c-154f080f2c55-delete_snapshot" released by "delete_snapshot" :: held 4.408s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-226b5414-a752-4db1-8ba9-aac7091e8d54-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-226b5414-a752-4db1-8ba9-aac7091e8d54-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:35 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[336dc397-d951-466d-a268-324e8a665f01]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:35 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54
Sep 23 00:24:35 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:36 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a" returned: 0 in 6.765s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56b87723-9036-473e-a3ba-d44e38283463_w8e44quwdevstack@QuobyteHD, size 112.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:24:36 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Converted 112.00 MB image at 16.55 MB/s
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:36 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54" returned: 0 in 1.100s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:36 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a 1G
Sep 23 00:24:36 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:36 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54
Sep 23 00:24:36 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:36 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-226b5414-a752-4db1-8ba9-aac7091e8d54" returned: 0 in 0.591s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-quobyte-226b5414-a752-4db1-8ba9-aac7091e8d54" released by "delete_volume" :: held 1.863s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Created reservations ['1e5177ef-85db-461f-80c9-bd0df95f926c', 'd1099230-1387-441b-b21c-4d45a55fc147', '0a3041a7-8d45-46cf-8313-32259c90d8f2', 'cd2a0737-b4cf-43a1-9bf7-b7acebe58dcc', 'aaf03fe8-7d1f-41fe-8d5c-3f3f69165f0a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:36 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a 1G" returned: 0 in 0.905s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:36 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Downloaded image 56b87723-9036-473e-a3ba-d44e38283463 ((None, [{'url': 'file:///opt/stack/data/glance/images/56b87723-9036-473e-a3ba-d44e38283463', 'metadata': {}}])) to volume 98cb6eb8-05db-4049-8b2f-97d06305dc7a successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Temporary image 56b87723-9036-473e-a3ba-d44e38283463 for user 9bb122ee44df4f62a0bd0d8d45af6fab is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Marking volume 98cb6eb8-05db-4049-8b2f-97d06305dc7a as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Copying metadata from image 56b87723-9036-473e-a3ba-d44e38283463 to 98cb6eb8-05db-4049-8b2f-97d06305dc7a. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Creating volume glance metadata for volume 98cb6eb8-05db-4049-8b2f-97d06305dc7a backed by image 56b87723-9036-473e-a3ba-d44e38283463 with: {'image_id': '56b87723-9036-473e-a3ba-d44e38283463', 'image_name': 'tempest-scenario-img--1367787808', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b4ebbe-9bd1-4d66-9b5c-ff7bc51534e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a', 'volume_size': 1, 'image_id': '56b87723-9036-473e-a3ba-d44e38283463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56b87723-9036-473e-a3ba-d44e38283463', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1367787808', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '886e268f44e3465cb46a71644378283a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '56b87723-9036-473e-a3ba-d44e38283463', 'created_at': datetime.datetime(2026, 9, 22, 22, 24, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 24, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56b87723-9036-473e-a3ba-d44e38283463/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf08b230>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8115a11-ad29-485a-8d8f-19ca4011ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Volume volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a (98cb6eb8-05db-4049-8b2f-97d06305dc7a): created successfully
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8115a11-ad29-485a-8d8f-19ca4011ee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:37 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:24:37 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Flow 'volume_create_manager' (72016672-15ab-480f-95b9-890a55a13aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:37 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2ce14c3e-f26e-4173-a512-9cd212398f80 tempest-TestInstancesWithCinderVolumes-1048714199 None] Created volume successfully.
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Flow 'volume_create_manager' (3991a238-d660-42ef-832d-2ba265cd7c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcf62b4-ae04-483d-8d69-7c79df173951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcf62b4-ae04-483d-8d69-7c79df173951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1527863428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355ea289-051b-487e-9d15-1b416a0cc69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abca62fbb4d4444ac0c5a5266abbb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:38Z,use_quota=True,user_id='ad809c68b42742f48a4f3766ed58105b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86403fac-9854-47ff-a935-36934c72350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86403fac-9854-47ff-a935-36934c72350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18576e0f-b500-4d9b-9f98-cc3415f1783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18576e0f-b500-4d9b-9f98-cc3415f1783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355ea289-051b-487e-9d15-1b416a0cc69c', 'volume_name': 'volume-355ea289-051b-487e-9d15-1b416a0cc69c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bdc555-4ca5-4d4d-ac63-9efb69dccc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bdc555-4ca5-4d4d-ac63-9efb69dccc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b20ff1a-b0df-446c-af2e-38178512a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Volume 355ea289-051b-487e-9d15-1b416a0cc69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355ea289-051b-487e-9d15-1b416a0cc69c', 'volume_size': 1}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:38 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 1.113s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Deleted volume successfully.
Sep 23 00:24:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e206c85a-d5d0-4a9e-af19-a32698fbcdaf tempest-VolumesSnapshotListTestJSON-823688695 None] Lock "cinder-226b5414-a752-4db1-8ba9-aac7091e8d54-delete_volume" released by "delete_volume" :: held 3.749s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:39 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d" returned: 0 in 10.068s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c, size 1024.00 MB, duration 10.07 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:24:39 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Converted 1024.00 MB image at 101.70 MB/s
Sep 23 00:24:39 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d is being set with open permissions: ugo+rw
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:39 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d
Sep 23 00:24:39 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:39 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d" returned: 0 in 0.360s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-bad5b893-b884-4c60-9d4a-000e5aefe17d" released by "_copy_volume_from_snapshot" :: held 11.650s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-89e9cf4f-f99d-4e37-b778-689cac6e9635-bad5b893-b884-4c60-9d4a-000e5aefe17d" released by "_create_volume_from_snapshot" :: held 11.747s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.778s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1527863428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355ea289-051b-487e-9d15-1b416a0cc69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abca62fbb4d4444ac0c5a5266abbb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:38Z,use_quota=True,user_id='ad809c68b42742f48a4f3766ed58105b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Creating volume 355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:39 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:39 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c 1073741824
Sep 23 00:24:39 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff635f19-8740-42d5-9f73-26080b234f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad5b893-b884-4c60-9d4a-000e5aefe17d', 'volume_size': 1, 'snapshot_id': '89e9cf4f-f99d-4e37-b778-689cac6e9635'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865bfd05-724b-4f3f-8668-49345fadad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Volume volume-bad5b893-b884-4c60-9d4a-000e5aefe17d (bad5b893-b884-4c60-9d4a-000e5aefe17d): created successfully
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865bfd05-724b-4f3f-8668-49345fadad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Flow 'volume_create_manager' (f2ea214e-6d3a-405d-b3db-6f9b3cbba80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-92c5a5c4-9a5c-4f2c-9d8d-5fdb19cb0354 tempest-VolumesDeleteCascade-2020940631 None] Created volume successfully.
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:39 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:24:39 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:40 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c 1073741824" returned: 0 in 0.724s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:40 devstack sudo[98695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c
Sep 23 00:24:40 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Performing cascade delete. {{(pid=87293) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-89e9cf4f-f99d-4e37-b778-689cac6e9635-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-89e9cf4f-f99d-4e37-b778-689cac6e9635-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-89e9cf4f-f99d-4e37-b778-689cac6e9635" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:40 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-89e9cf4f-f99d-4e37-b778-689cac6e9635" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Deleting offline snapshot 89e9cf4f-f99d-4e37-b778-689cac6e9635 of volume 71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] snapshot_file for this snap is: volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.619s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f258ac5-318d-4002-987d-2e5f779427f3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:40 devstack sudo[98701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635
Sep 23 00:24:40 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:40 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c" returned: 0 in 0.563s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b20ff1a-b0df-446c-af2e-38178512a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355ea289-051b-487e-9d15-1b416a0cc69c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d48d59-bf25-4ae1-8512-673269ccead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:40 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Volume volume-355ea289-051b-487e-9d15-1b416a0cc69c (355ea289-051b-487e-9d15-1b416a0cc69c): created successfully
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d48d59-bf25-4ae1-8512-673269ccead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Flow 'volume_create_manager' (3991a238-d660-42ef-832d-2ba265cd7c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:40 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-49143a02-08b7-488b-8bb4-24fd09ac7d96 tempest-VolumesCloneTest-1257466408 None] Created volume successfully.
Sep 23 00:24:41 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635" returned: 0 in 0.700s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:41 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[859178e2-bc62-4625-801b-bf683cc6b722]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:41 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c
Sep 23 00:24:41 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Flow 'volume_create_manager' (28d2abba-a7f9-4d24-b15a-9f848400de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166aa7e9-ff6d-46be-bfbc-d36d756a06e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166aa7e9-ff6d-46be-bfbc-d36d756a06e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1823803528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88281a3-2143-42f3-8573-7feae2219f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abca62fbb4d4444ac0c5a5266abbb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=355ea289-051b-487e-9d15-1b416a0cc69c,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:42Z,use_quota=True,user_id='ad809c68b42742f48a4f3766ed58105b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7c640a-2b48-47a5-80bd-c15625493bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7c640a-2b48-47a5-80bd-c15625493bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6669ed74-cb07-4f0a-b780-8d517ffc5fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6669ed74-cb07-4f0a-b780-8d517ffc5fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f88281a3-2143-42f3-8573-7feae2219f3d', 'volume_name': 'volume-f88281a3-2143-42f3-8573-7feae2219f3d', 'volume_size': 2, 'source_volid': '355ea289-051b-487e-9d15-1b416a0cc69c', 'source_volstatus': 'available'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd5319a-e05d-4bfa-8b22-d4501c43d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd5319a-e05d-4bfa-8b22-d4501c43d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403783c9-7be5-411b-bd7c-c706b1bc0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Volume f88281a3-2143-42f3-8573-7feae2219f3d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f88281a3-2143-42f3-8573-7feae2219f3d', 'volume_size': 2, 'source_volid': '355ea289-051b-487e-9d15-1b416a0cc69c', 'source_volstatus': 'available'}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:42 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Cloning volume 355ea289-051b-487e-9d15-1b416a0cc69c to volume f88281a3-2143-42f3-8573-7feae2219f3d
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Creating offline snapshot 35cc1635-1c49-47bc-ad74-857cd694fd48 of volume 355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcb104e-061a-43d0-bc6d-74095d913696]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:42 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" returned: 0 in 1.048s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:42 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635
Sep 23 00:24:42 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:42 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c
Sep 23 00:24:42 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:42 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635" returned: 0 in 0.555s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:42 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635
Sep 23 00:24:42 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:43 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c" returned: 0 in 0.797s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:43 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 1G
Sep 23 00:24:43 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-98fe7262-e31a-4821-ad52-09acdc30bbe8 req-4d057376-fdcb-459e-b7cd-075046ab6466 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:43 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c.89e9cf4f-f99d-4e37-b778-689cac6e9635" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-89e9cf4f-f99d-4e37-b778-689cac6e9635" released by "_delete_snapshot" :: held 2.890s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" released by "delete_snapshot" :: held 2.921s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Created reservations ['2a29945c-3615-4c8d-b358-f8451fa06fdf', '7ac573c9-4465-4999-9e3b-b912935e626c', 'e7947b73-e2a9-4b54-a49a-cba22acfdf51', 'c1d332ee-f5b0-4bed-8d06-111428a61f25', 'cd41d1c5-341e-4ef3-9f47-43f5519b9ad5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Delete snapshot completed successfully.
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-89e9cf4f-f99d-4e37-b778-689cac6e9635-delete_snapshot" released by "delete_snapshot" :: held 3.224s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Snapshots deleted, issuing volume delete {{(pid=87293) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad30bf3-b493-406d-b7de-3b783e5c919b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:43 devstack sudo[98741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c
Sep 23 00:24:43 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:44 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 1G" returned: 0 in 0.889s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355ea289-051b-487e-9d15-1b416a0cc69c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:44 devstack sudo[98743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355ea289-051b-487e-9d15-1b416a0cc69c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48
Sep 23 00:24:44 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:44 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" returned: 0 in 0.712s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:44 devstack sudo[98750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c
Sep 23 00:24:44 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:44 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355ea289-051b-487e-9d15-1b416a0cc69c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48" returned: 0 in 0.547s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:44 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 is being set with open permissions: ugo+rw
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:44 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48
Sep 23 00:24:44 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:44 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" returned: 0 in 0.498s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c" released by "delete_volume" :: held 1.309s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:45 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:45 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info
Sep 23 00:24:45 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Created reservations ['bfcd0ebc-610b-4e01-b930-d541679133eb', 'b1e8cf44-e0e0-4637-9a15-cab801c5b91f', '94d42aac-a874-4821-8151-4c6aa9923365', 'eda9906e-9982-4f14-8e2f-05a53b7c9e8a', 'd62a5012-7891-43f6-985d-cc557eb2f503'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:45 devstack sudo[98759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:24:45 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:45 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info" returned: 0 in 0.517s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:45 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info is being set with open permissions: ugo+rw
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:45 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info
Sep 23 00:24:45 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Flow 'volume_create_manager' (d3f59d59-107e-4ed6-a7d2-a33c20dea14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37a6fa8-040b-4403-9346-7c7dc21109ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37a6fa8-040b-4403-9346-7c7dc21109ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2107737515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187b2c66-f80a-4e5a-9a0d-4c061bba353f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da271b2a8854f5bbef67b6896b4e22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:46Z,use_quota=True,user_id='ee6fb142721b45c2a6a164d38670dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4c56b7-45f6-4fc8-8fe9-95ee97d6bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4c56b7-45f6-4fc8-8fe9-95ee97d6bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de339d25-569c-448f-b7d7-11003c994895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de339d25-569c-448f-b7d7-11003c994895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187b2c66-f80a-4e5a-9a0d-4c061bba353f', 'volume_name': 'volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f', 'volume_size': 2}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7852c5c3-ef6f-4821-9dab-325e148a5c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7852c5c3-ef6f-4821-9dab-325e148a5c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e80331-c9b1-4947-9b67-a03ef65ada6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:45 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Volume 187b2c66-f80a-4e5a-9a0d-4c061bba353f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f', 'volume_size': 2}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:45 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.540s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:45 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Deleted volume successfully.
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5c0372ea-f81a-4ced-9024-7acd8c1480f1 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-71be362c-af35-4c0a-a6b1-9fa40f1fdf1c-delete_volume" released by "delete_volume" :: held 5.730s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:46 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-bad5b893-b884-4c60-9d4a-000e5aefe17d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.info" returned: 0 in 0.443s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Acquiring lock "cinder-quobyte-f88281a3-2143-42f3-8573-7feae2219f3d" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-bad5b893-b884-4c60-9d4a-000e5aefe17d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-f88281a3-2143-42f3-8573-7feae2219f3d" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] snapshot: 35cc1635-1c49-47bc-ad74-857cd694fd48, volume: f88281a3-2143-42f3-8573-7feae2219f3d,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41ce434-65fd-4f2c-ae73-880b6a7bd473]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "cinder-quobyte-bad5b893-b884-4c60-9d4a-000e5aefe17d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-bad5b893-b884-4c60-9d4a-000e5aefe17d" acquired by "delete_volume" :: waited 0.045s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ffbc0-1edf-4ef4-9647-0961124db607]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:46 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48
Sep 23 00:24:46 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:46 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d
Sep 23 00:24:46 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:46 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48" returned: 0 in 0.627s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-355ea289-051b-487e-9d15-1b416a0cc69c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b3d17-9fe9-4a4f-98bb-476481c6ee82]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:47 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d" returned: 0 in 0.621s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:47 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c
Sep 23 00:24:47 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:47 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d
Sep 23 00:24:47 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:47 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:47 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c" returned: 0 in 0.431s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bad5b893-b884-4c60-9d4a-000e5aefe17d" returned: 0 in 0.330s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:47 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d
Sep 23 00:24:47 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-quobyte-bad5b893-b884-4c60-9d4a-000e5aefe17d" released by "delete_volume" :: held 1.032s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Created reservations ['d3d4dc4c-180e-4469-93c4-54c920f303d7', '62966dd0-c176-4539-8ba0-3087a7e103ca', '7a23fb35-1c6b-458f-bc2c-f4d7679a5d1e', 'ede7a90c-2fb8-4a41-9556-ae532f99f293', '4be147d0-843d-4b7b-8afa-365a7334e693'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:47 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:24:47 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:48 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.459s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Deleted volume successfully.
Sep 23 00:24:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f947ee-e79e-4ef5-a079-fa45ac6ba975 tempest-VolumesDeleteCascade-2020940631 None] Lock "cinder-bad5b893-b884-4c60-9d4a-000e5aefe17d-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:56 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d" returned: 0 in 8.863s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c, size 1024.00 MB, duration 8.86 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:24:56 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Converted 1024.00 MB image at 115.53 MB/s
Sep 23 00:24:56 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d is being set with open permissions: ugo+rw
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:56 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d
Sep 23 00:24:56 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:56 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d" returned: 0 in 0.314s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-f88281a3-2143-42f3-8573-7feae2219f3d" released by "_copy_volume_from_snapshot" :: held 10.386s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Acquiring lock "cinder-quobyte-35cc1635-1c49-47bc-ad74-857cd694fd48" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-35cc1635-1c49-47bc-ad74-857cd694fd48" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Deleting offline snapshot 35cc1635-1c49-47bc-ad74-857cd694fd48 of volume 355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] snapshot_file for this snap is: volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edeb04e-5bec-489a-a82b-41d5f4f58506]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:56 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48
Sep 23 00:24:56 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:57 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48" returned: 0 in 0.477s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-355ea289-051b-487e-9d15-1b416a0cc69c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:57 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e883b7-e779-4ff4-848c-af8c1d244742]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:57 devstack sudo[98811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c
Sep 23 00:24:57 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:57 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c" returned: 0 in 0.656s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:57 devstack sudo[98816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48
Sep 23 00:24:57 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=89,cinder:UPDATE=82,cinder:DELETE=6,cinder:INSERT=32 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:58 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48" returned: 0 in 0.441s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:58 devstack sudo[98824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48
Sep 23 00:24:58 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Flow 'volume_create_manager' (be564b9a-325f-4341-b877-fd48db2477f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2675c4-0305-489e-928c-4db9008c9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:58 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2675c4-0305-489e-928c-4db9008c9751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-438417935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1361c4-916a-4206-a3fb-efbe0af7b758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f0deb5a77643028bb9867e29a8e7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:58Z,use_quota=True,user_id='79b7fcdae1374cfe93851a718b73fa5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27612743-fcd2-4051-bee8-fc85116cda7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27612743-fcd2-4051-bee8-fc85116cda7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ca631d-a8ba-46a4-8933-7c757a2a4e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ca631d-a8ba-46a4-8933-7c757a2a4e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1361c4-916a-4206-a3fb-efbe0af7b758', 'volume_name': 'volume-2f1361c4-916a-4206-a3fb-efbe0af7b758', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f4e330-07e9-48b6-bcea-9c45c760127f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f4e330-07e9-48b6-bcea-9c45c760127f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cab35c-4d58-466d-8f1d-3d5b5dc32130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Volume 2f1361c4-916a-4206-a3fb-efbe0af7b758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1361c4-916a-4206-a3fb-efbe0af7b758', 'volume_size': 1}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c.35cc1635-1c49-47bc-ad74-857cd694fd48" returned: 0 in 0.412s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-35cc1635-1c49-47bc-ad74-857cd694fd48" released by "_delete_snapshot" :: held 2.098s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.473s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-98fe7262-e31a-4821-ad52-09acdc30bbe8 req-4d057376-fdcb-459e-b7cd-075046ab6466 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.480s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-98fe7262-e31a-4821-ad52-09acdc30bbe8 req-4d057376-fdcb-459e-b7cd-075046ab6466 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.788s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2107737515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187b2c66-f80a-4e5a-9a0d-4c061bba353f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da271b2a8854f5bbef67b6896b4e22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:46Z,use_quota=True,user_id='ee6fb142721b45c2a6a164d38670dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Creating volume 187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:58 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f 2147483648 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403783c9-7be5-411b-bd7c-c706b1bc0e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88281a3-2143-42f3-8573-7feae2219f3d', 'volume_size': 2, 'source_volid': '355ea289-051b-487e-9d15-1b416a0cc69c', 'source_volstatus': 'available'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee5a5d1-d80b-4811-a820-e7a8fd702bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:58 devstack sudo[98828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f 2147483648
Sep 23 00:24:58 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Volume volume-f88281a3-2143-42f3-8573-7feae2219f3d (f88281a3-2143-42f3-8573-7feae2219f3d): created successfully
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee5a5d1-d80b-4811-a820-e7a8fd702bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Flow 'volume_create_manager' (28d2abba-a7f9-4d24-b15a-9f848400de03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-98fe7262-e31a-4821-ad52-09acdc30bbe8 req-4d057376-fdcb-459e-b7cd-075046ab6466 tempest-TestInstancesWithCinderVolumes-1048714199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1abf91d1-744b-4cce-848e-f89d17620c86', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:24:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bf5145a7-282f-431f-8990-09f218f17044 tempest-VolumesCloneTest-1257466408 None] Created volume successfully.
Sep 23 00:24:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-98fe7262-e31a-4821-ad52-09acdc30bbe8 req-4d057376-fdcb-459e-b7cd-075046ab6466 tempest-TestInstancesWithCinderVolumes-1048714199 None] attachment_update completed successfully.
Sep 23 00:24:59 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f 2147483648" returned: 0 in 0.656s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:59 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f
Sep 23 00:24:59 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:59 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f" returned: 0 in 0.354s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-438417935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1361c4-916a-4206-a3fb-efbe0af7b758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f0deb5a77643028bb9867e29a8e7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:58Z,use_quota=True,user_id='79b7fcdae1374cfe93851a718b73fa5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Creating volume 2f1361c4-916a-4206-a3fb-efbe0af7b758 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:59 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:59 devstack sudo[98932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 1073741824
Sep 23 00:24:59 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e80331-c9b1-4947-9b67-a03ef65ada6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f', 'volume_size': 2}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc06fd9-1c9e-4ef7-af86-b26c4feff055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=88,cinder:UPDATE=101,cinder:DELETE=7,cinder:INSERT=28 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Volume volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f (187b2c66-f80a-4e5a-9a0d-4c061bba353f): created successfully
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc06fd9-1c9e-4ef7-af86-b26c4feff055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Flow 'volume_create_manager' (d3f59d59-107e-4ed6-a7d2-a33c20dea14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b3907a8d-38a9-4f9e-9ee7-7c8719f49217 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Created volume successfully.
Sep 23 00:25:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Acquiring lock "cinder-f88281a3-2143-42f3-8573-7feae2219f3d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Lock "cinder-f88281a3-2143-42f3-8573-7feae2219f3d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Acquiring lock "cinder-quobyte-f88281a3-2143-42f3-8573-7feae2219f3d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-f88281a3-2143-42f3-8573-7feae2219f3d" acquired by "delete_volume" :: waited 0.066s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38e59a-441c-4241-bc9d-9d613bf54970]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:00 devstack sudo[98990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d
Sep 23 00:25:00 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:01 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 1073741824" returned: 0 in 1.236s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:01 devstack sudo[99554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758
Sep 23 00:25:01 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:01 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d" returned: 0 in 1.059s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:01 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d
Sep 23 00:25:01 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:02 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f88281a3-2143-42f3-8573-7feae2219f3d" returned: 0 in 0.629s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-f88281a3-2143-42f3-8573-7feae2219f3d" released by "delete_volume" :: held 1.873s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:02 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758" returned: 0 in 0.946s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.536s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cab35c-4d58-466d-8f1d-3d5b5dc32130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1361c4-916a-4206-a3fb-efbe0af7b758', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0422c6-6fe2-40d9-94d8-e2d8cdc6bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Creating offline snapshot ec4ef43e-1006-4d55-88d1-cd8de0544f9f of volume 187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:25:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Volume volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 (2f1361c4-916a-4206-a3fb-efbe0af7b758): created successfully
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0422c6-6fe2-40d9-94d8-e2d8cdc6bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Flow 'volume_create_manager' (be564b9a-325f-4341-b877-fd48db2477f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d61e0-0f4d-4f43-90dc-3624abe28fc9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Created reservations ['7f2abe8a-cda3-4131-afa2-4f2bb5e886c8', '057ee7a2-2ebd-4e48-bf0a-edb568a4b5be', '83cc6cec-3ee4-42b2-a473-81da99721dff', '8fa1a4cf-0373-4458-8917-e8df5369eb68', '383728f5-0276-431b-a4ce-17d69ab35dee'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7cef8391-97c1-4d7b-8cfd-866e9229b136 tempest-VolumesTransfersTest-1936777068 None] Created volume successfully.
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:02 devstack sudo[99883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:02 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:02 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f
Sep 23 00:25:02 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Acquiring lock "cinder-355ea289-051b-487e-9d15-1b416a0cc69c-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Lock "cinder-355ea289-051b-487e-9d15-1b416a0cc69c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Acquiring lock "cinder-quobyte-355ea289-051b-487e-9d15-1b416a0cc69c" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-355ea289-051b-487e-9d15-1b416a0cc69c" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4109c003-45fe-4e19-a3ba-e32fa3c9d8f3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:03 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.451s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Deleted volume successfully.
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47c5fbeb-35d7-4e4e-9fe5-cf6901dedf0f tempest-VolumesCloneTest-1257466408 None] Lock "cinder-f88281a3-2143-42f3-8573-7feae2219f3d-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:03 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c
Sep 23 00:25:03 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:03 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f" returned: 0 in 1.224s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f 2G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:03 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f 2G
Sep 23 00:25:03 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:03 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c" returned: 0 in 0.854s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:03 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c
Sep 23 00:25:03 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:04 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-355ea289-051b-487e-9d15-1b416a0cc69c" returned: 0 in 0.432s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Lock "cinder-quobyte-355ea289-051b-487e-9d15-1b416a0cc69c" released by "delete_volume" :: held 1.400s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:04 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f 2G" returned: 0 in 0.807s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:04 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f
Sep 23 00:25:04 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Created reservations ['1430d3f6-c437-4b3b-ada0-3120b18a54ab', '4f5816f6-bba4-4ad5-8a1e-fd7bf8cf55d0', '9a8c6aae-8bf7-43d3-a881-66d6d62b0635', '03b30808-8d3f-4d24-a753-17b00a5d22e9', 'fb56ee4e-9658-46fa-a4cc-08fbf9bc138a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:04 devstack sudo[99920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:04 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:04 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ea795cd6-3b33-4ad1-aa32-14e8f38a4a50 tempest-VolumesTransfersTest-2035336708 None] Transfer volume completed successfully.
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f" returned: 0 in 0.561s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:04 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f is being set with open permissions: ugo+rw
Sep 23 00:25:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:04 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f
Sep 23 00:25:04 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:05 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.421s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:05 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Deleted volume successfully.
Sep 23 00:25:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f1810916-9cfb-46cf-8296-ca8414250caf tempest-VolumesCloneTest-1257466408 None] Lock "cinder-355ea289-051b-487e-9d15-1b416a0cc69c-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:05 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f" returned: 0 in 0.471s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:05 devstack sudo[99929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info
Sep 23 00:25:05 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:06 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info" returned: 0 in 0.584s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:06 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info is being set with open permissions: ugo+rw
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:06 devstack sudo[99932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info
Sep 23 00:25:06 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Acquiring lock "cinder-2f1361c4-916a-4206-a3fb-efbe0af7b758-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-2f1361c4-916a-4206-a3fb-efbe0af7b758-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Acquiring lock "cinder-quobyte-2f1361c4-916a-4206-a3fb-efbe0af7b758" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-quobyte-2f1361c4-916a-4206-a3fb-efbe0af7b758" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce38e31-b21a-4bd4-9c0c-8f220a7e043c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:06 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.info" returned: 0 in 0.531s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.451s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:06 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758
Sep 23 00:25:06 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f8cee218-9684-4975-a0dd-b7b1b27bbb3e tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Create snapshot completed successfully
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "cinder-ec4ef43e-1006-4d55-88d1-cd8de0544f9f-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-ec4ef43e-1006-4d55-88d1-cd8de0544f9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "cinder-quobyte-187b2c66-f80a-4e5a-9a0d-4c061bba353f" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-quobyte-187b2c66-f80a-4e5a-9a0d-4c061bba353f" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "cinder-quobyte-ec4ef43e-1006-4d55-88d1-cd8de0544f9f" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-quobyte-ec4ef43e-1006-4d55-88d1-cd8de0544f9f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Deleting offline snapshot ec4ef43e-1006-4d55-88d1-cd8de0544f9f of volume 187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] snapshot_file for this snap is: volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a035f84-06b9-4ded-85ac-f9e74940491d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:07 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758" returned: 0 in 0.956s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:07 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758
Sep 23 00:25:07 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:07 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f
Sep 23 00:25:07 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:07 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2f1361c4-916a-4206-a3fb-efbe0af7b758" returned: 0 in 0.526s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-quobyte-2f1361c4-916a-4206-a3fb-efbe0af7b758" released by "delete_volume" :: held 1.570s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Created reservations ['7f8864a9-df46-48aa-a51e-32f07dc32c10', '65a38d67-73f5-46a3-8443-bfbbfaf560ec', 'd7719a36-22f5-4da7-b6b5-f6a9696aa9bd', '0f6ea886-4969-4a6f-b912-dc82a98a5a40', '7c6b3026-3c5d-46c2-8556-5a14de3635b3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:08 devstack sudo[99948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:08 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:08 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f" returned: 0 in 1.118s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[193101eb-b476-4c4f-951f-1b0e2c36830d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:08 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f
Sep 23 00:25:08 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:09 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.716s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:09 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Deleted volume successfully.
Sep 23 00:25:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-242924ed-ce44-4c74-9e51-e1d6d0e42c39 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-2f1361c4-916a-4206-a3fb-efbe0af7b758-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:09 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f" returned: 0 in 0.937s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:09 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f
Sep 23 00:25:09 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Flow 'volume_create_manager' (383e9919-333d-4e3d-98ce-1f6a4dd2a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1460ee8-3ea1-49d5-8c3b-32e3ab3d75d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1460ee8-3ea1-49d5-8c3b-32e3ab3d75d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-937736485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1abf8d-6d26-4f3a-b80d-a814279bbd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f0deb5a77643028bb9867e29a8e7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:10Z,use_quota=True,user_id='79b7fcdae1374cfe93851a718b73fa5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1dabf1e-51de-4b74-91d8-1e2d1d5fcf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1dabf1e-51de-4b74-91d8-1e2d1d5fcf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183e0013-86f0-4d42-adf9-41f32d3c10d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183e0013-86f0-4d42-adf9-41f32d3c10d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1abf8d-6d26-4f3a-b80d-a814279bbd18', 'volume_name': 'volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95038d8-c0e6-484c-9797-d7ae101a487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95038d8-c0e6-484c-9797-d7ae101a487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef2714b-7405-4f00-9bdb-1e5843f12557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:10 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Volume dc1abf8d-6d26-4f3a-b80d-a814279bbd18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18', 'volume_size': 1}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-937736485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1abf8d-6d26-4f3a-b80d-a814279bbd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f0deb5a77643028bb9867e29a8e7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:10Z,use_quota=True,user_id='79b7fcdae1374cfe93851a718b73fa5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Creating volume dc1abf8d-6d26-4f3a-b80d-a814279bbd18 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:25:10 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:10 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 1073741824
Sep 23 00:25:10 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:10 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f" returned: 0 in 1.118s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:10 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f
Sep 23 00:25:10 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:11 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f.ec4ef43e-1006-4d55-88d1-cd8de0544f9f" returned: 0 in 0.458s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:11 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 1073741824" returned: 0 in 0.778s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-quobyte-ec4ef43e-1006-4d55-88d1-cd8de0544f9f" released by "_delete_snapshot" :: held 3.882s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-quobyte-187b2c66-f80a-4e5a-9a0d-4c061bba353f" released by "delete_snapshot" :: held 3.946s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:11 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18
Sep 23 00:25:11 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Created reservations ['d3cfced0-d5a6-4a3d-bfc5-e642d829f164', '2dfeb946-d052-4745-adaa-c475c3b7cbd1', 'ca8a6034-bf68-4e35-a35c-e5b52583fc86', '4891975d-a1e1-4779-a9ba-ea5ebbde146d', '7d8d26db-946b-46f0-bcb7-04d0acc35ef6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Delete snapshot completed successfully.
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0ed233eb-d08a-4206-bc51-3df19a04d05f tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-ec4ef43e-1006-4d55-88d1-cd8de0544f9f-delete_snapshot" released by "delete_snapshot" :: held 4.479s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:11 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18" returned: 0 in 0.576s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef2714b-7405-4f00-9bdb-1e5843f12557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ab5a9f-a9ff-4fde-829f-0fe79c266ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "cinder-187b2c66-f80a-4e5a-9a0d-4c061bba353f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Volume volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 (dc1abf8d-6d26-4f3a-b80d-a814279bbd18): created successfully
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ab5a9f-a9ff-4fde-829f-0fe79c266ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Flow 'volume_create_manager' (383e9919-333d-4e3d-98ce-1f6a4dd2a108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-187b2c66-f80a-4e5a-9a0d-4c061bba353f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f80207d6-b193-4cb3-bb65-fcb6f8fff422 tempest-VolumesTransfersTest-1936777068 None] Created volume successfully.
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "cinder-quobyte-187b2c66-f80a-4e5a-9a0d-4c061bba353f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-quobyte-187b2c66-f80a-4e5a-9a0d-4c061bba353f" acquired by "delete_volume" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f328ddc-4894-453f-bde8-1edd39834296]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:12 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f
Sep 23 00:25:12 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Acquiring lock "cinder-dc1abf8d-6d26-4f3a-b80d-a814279bbd18-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-dc1abf8d-6d26-4f3a-b80d-a814279bbd18-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Acquiring lock "cinder-quobyte-dc1abf8d-6d26-4f3a-b80d-a814279bbd18" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-quobyte-dc1abf8d-6d26-4f3a-b80d-a814279bbd18" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec426a45-450f-40d5-856f-8df85dbf55bb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:13 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f" returned: 0 in 1.093s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:13 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f
Sep 23 00:25:13 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:13 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18
Sep 23 00:25:13 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:13 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-187b2c66-f80a-4e5a-9a0d-4c061bba353f" returned: 0 in 0.445s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-quobyte-187b2c66-f80a-4e5a-9a0d-4c061bba353f" released by "delete_volume" :: held 1.710s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Created reservations ['e34cc04d-6720-4959-babe-075982ae3b5b', '55a2fe6a-3fed-412a-a9df-1f44bc6c1a55', '86368ddc-b4c7-40a3-9850-eb1ad5a23f64', '494c1571-e121-4106-8e8a-6b478a9da738', '03119718-5c7b-4750-8d27-bf7b4d2c87aa'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:14 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18" returned: 0 in 0.777s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:14 devstack sudo[99996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18
Sep 23 00:25:14 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:14 devstack sudo[99998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:14 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:14 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dc1abf8d-6d26-4f3a-b80d-a814279bbd18" returned: 0 in 0.724s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-quobyte-dc1abf8d-6d26-4f3a-b80d-a814279bbd18" released by "delete_volume" :: held 1.594s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:14 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.639s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:14 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Deleted volume successfully.
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Created reservations ['bbd63eac-5c4b-4853-ac3a-d79594b1f62c', 'b5bb6b96-35fa-456c-bc6f-9192bc57f298', 'eef0ef7c-02d3-4d9b-b5c7-bd1ece0883bf', '23fd918c-c4f0-42d0-ba60-0156bdfea674', '7247e7c5-1592-4964-b765-42cb6dcc4c0b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2b84127-a838-45da-b435-12909f1bdbd4 tempest-VolumesSnapshotNegativeTestJSON-295565847 None] Lock "cinder-187b2c66-f80a-4e5a-9a0d-4c061bba353f-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:15 devstack sudo[100002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:15 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:15 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.476s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Deleted volume successfully.
Sep 23 00:25:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cf25bdc2-1cce-44c7-9a9f-496f4f3cc4d0 tempest-VolumesTransfersTest-1342458787 None] Lock "cinder-dc1abf8d-6d26-4f3a-b80d-a814279bbd18-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:25 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=55,cinder:SELECT=47,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:25:25 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=69,cinder:SELECT=46,cinder:DELETE=7,cinder:INSERT=13 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (9e07b6d0-07f5-4e1b-9407-431941ecff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3af7c97-2b39-4b10-8699-06e45aa70f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3af7c97-2b39-4b10-8699-06e45aa70f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1788933605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30589bf-cebf-486f-b4e2-9b0c43d6e049,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:35Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af4e0eb-9e25-432c-96aa-bf614b2e3401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af4e0eb-9e25-432c-96aa-bf614b2e3401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274243b8-4d77-43a7-8b32-188fe014b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274243b8-4d77-43a7-8b32-188fe014b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30589bf-cebf-486f-b4e2-9b0c43d6e049', 'volume_name': 'volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94b8200-bb17-4aa8-8e53-9081b10cf7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94b8200-bb17-4aa8-8e53-9081b10cf7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e29fcb1-ebe3-46a4-a508-cc8b8bb001f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Volume e30589bf-cebf-486f-b4e2-9b0c43d6e049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049', 'volume_size': 1}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1788933605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30589bf-cebf-486f-b4e2-9b0c43d6e049,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:35Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Creating volume e30589bf-cebf-486f-b4e2-9b0c43d6e049 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:25:35 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:35 devstack sudo[100184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 1073741824
Sep 23 00:25:35 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-daf59016-857c-4bdf-8de7-0aee5c290efd req-38bc5660-b7c5-49b1-9b1e-5075c4347e28 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:35 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 1073741824" returned: 0 in 0.647s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:35 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049
Sep 23 00:25:35 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:36 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049" returned: 0 in 0.387s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-daf59016-857c-4bdf-8de7-0aee5c290efd req-38bc5660-b7c5-49b1-9b1e-5075c4347e28 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.466s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e29fcb1-ebe3-46a4-a508-cc8b8bb001f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03acddc-163a-41bf-98c8-a32ec6fed845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-daf59016-857c-4bdf-8de7-0aee5c290efd req-38bc5660-b7c5-49b1-9b1e-5075c4347e28 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Volume volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 (e30589bf-cebf-486f-b4e2-9b0c43d6e049): created successfully
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03acddc-163a-41bf-98c8-a32ec6fed845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (9e07b6d0-07f5-4e1b-9407-431941ecff18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c90a9280-fe5e-4284-9f01-9dead7d60dcc tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:25:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-daf59016-857c-4bdf-8de7-0aee5c290efd req-38bc5660-b7c5-49b1-9b1e-5075c4347e28 tempest-TestInstancesWithCinderVolumes-1048714199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33115c78-836c-404b-897e-0f8040c8b0df', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:25:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-daf59016-857c-4bdf-8de7-0aee5c290efd req-38bc5660-b7c5-49b1-9b1e-5075c4347e28 tempest-TestInstancesWithCinderVolumes-1048714199 None] attachment_update completed successfully.
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (e7813a6a-aeb8-4154-b377-be26820d59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47f3add-e01b-4cb1-a135-e2b28da4dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47f3add-e01b-4cb1-a135-e2b28da4dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1102368775',display_name='tempest-VolumesGetTest-Volume-1905116008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8d802a-d838-4881-9247-478c7cac9540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:38Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad10ebcb-9947-4b9e-b823-0512c5192006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad10ebcb-9947-4b9e-b823-0512c5192006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca601af-11fd-4703-8b9b-fedece4efac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca601af-11fd-4703-8b9b-fedece4efac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8d802a-d838-4881-9247-478c7cac9540', 'volume_name': 'volume-da8d802a-d838-4881-9247-478c7cac9540', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafb648d-8039-4065-83c9-dcf97ff51f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafb648d-8039-4065-83c9-dcf97ff51f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49be9820-1407-4592-a3c5-1c3bfc2bb4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Volume da8d802a-d838-4881-9247-478c7cac9540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8d802a-d838-4881-9247-478c7cac9540', 'volume_size': 1}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1102368775',display_name='tempest-VolumesGetTest-Volume-1905116008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8d802a-d838-4881-9247-478c7cac9540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:38Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Creating volume da8d802a-d838-4881-9247-478c7cac9540 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:25:38 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:25:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:38 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540 1073741824
Sep 23 00:25:38 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:39 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540 1073741824" returned: 0 in 0.925s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:39 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540
Sep 23 00:25:39 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:40 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:40 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-e43a6d4c-106b-472f-9b31-78379ba0d2fe req-eed4c7cc-5c33-43b3-aaf8-d1a21b64dff3 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:40 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-e43a6d4c-106b-472f-9b31-78379ba0d2fe req-eed4c7cc-5c33-43b3-aaf8-d1a21b64dff3 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.145s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49be9820-1407-4592-a3c5-1c3bfc2bb4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8d802a-d838-4881-9247-478c7cac9540', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7313c8b3-6098-498d-a703-b7c18b0dc044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-e43a6d4c-106b-472f-9b31-78379ba0d2fe req-eed4c7cc-5c33-43b3-aaf8-d1a21b64dff3 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:40 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Volume volume-da8d802a-d838-4881-9247-478c7cac9540 (da8d802a-d838-4881-9247-478c7cac9540): created successfully
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7313c8b3-6098-498d-a703-b7c18b0dc044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (e7813a6a-aeb8-4154-b377-be26820d59dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:40 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:40 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5a04f8f9-4036-4bfd-8d7d-4385c00ba74e tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.437s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-e43a6d4c-106b-472f-9b31-78379ba0d2fe req-eed4c7cc-5c33-43b3-aaf8-d1a21b64dff3 tempest-TestInstancesWithCinderVolumes-1048714199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaa22bb8-6ead-42bd-8b4a-c498e6a28119', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:25:40 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-e43a6d4c-106b-472f-9b31-78379ba0d2fe req-eed4c7cc-5c33-43b3-aaf8-d1a21b64dff3 tempest-TestInstancesWithCinderVolumes-1048714199 None] attachment_update completed successfully.
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-da8d802a-d838-4881-9247-478c7cac9540-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-da8d802a-d838-4881-9247-478c7cac9540-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-da8d802a-d838-4881-9247-478c7cac9540" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-da8d802a-d838-4881-9247-478c7cac9540" acquired by "delete_volume" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:41 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91eb828-8302-418c-975d-035736ac567a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:41 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540
Sep 23 00:25:41 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:41 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540" returned: 0 in 0.771s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:41 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540
Sep 23 00:25:41 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:42 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da8d802a-d838-4881-9247-478c7cac9540" returned: 0 in 0.448s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-da8d802a-d838-4881-9247-478c7cac9540" released by "delete_volume" :: held 1.301s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Created reservations ['cea22143-ecef-4de5-8db2-c9137b92037e', '0c52ee2f-18af-4916-803e-90cee847eba6', '03ccd396-848b-41e1-b700-66915eb2c827', 'a87978c7-9d05-43dc-8025-dacf169cd5f4', '22969bf5-7f4d-48a1-a03c-ae2f611adc56'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:42 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:42 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:42 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.327s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:25:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2a188b22-14f6-439c-8c6f-d6e3ac1ee6e0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-da8d802a-d838-4881-9247-478c7cac9540-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-e30589bf-cebf-486f-b4e2-9b0c43d6e049-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Lock "cinder-e30589bf-cebf-486f-b4e2-9b0c43d6e049-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-e30589bf-cebf-486f-b4e2-9b0c43d6e049" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-e30589bf-cebf-486f-b4e2-9b0c43d6e049" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a79583-2fae-4ab7-aebf-7de0fa4d37da]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:43 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049
Sep 23 00:25:43 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:44 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049" returned: 0 in 0.615s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:44 devstack sudo[100261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049
Sep 23 00:25:44 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:44 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e30589bf-cebf-486f-b4e2-9b0c43d6e049" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-e30589bf-cebf-486f-b4e2-9b0c43d6e049" released by "delete_volume" :: held 1.101s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Created reservations ['1d568247-b5cc-439b-a389-6967c3fbac2c', '89118f3c-8344-41e9-8621-1bd717b71f29', '58deaa02-2066-4049-8ea8-3554cb382561', 'e4e419ed-22ff-4364-884e-72ca9b789fad', '525d2509-5c06-4583-918f-e403b05e18d4'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:45 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:45 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:45 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.508s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:45 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:25:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-398a9de9-9502-4a68-9044-ae36ccaf507b tempest-VolumesGetTest-1860593986 None] Lock "cinder-e30589bf-cebf-486f-b4e2-9b0c43d6e049-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (e7e980b8-9b42-473f-bbc5-e3f2b1051ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb8072f-229b-4b59-86cb-ebbd2ab4d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb8072f-229b-4b59-86cb-ebbd2ab4d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-192789708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cf42d2-9663-48eb-bcb4-7c85377ff901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22ff496-bdc4-4252-9e2e-5ef3d8267fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22ff496-bdc4-4252-9e2e-5ef3d8267fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c565ced-347e-49bb-8a81-3237933da7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c565ced-347e-49bb-8a81-3237933da7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'volume_name': 'volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c42735-afc7-48fe-8598-efc1a9278c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c42735-afc7-48fe-8598-efc1a9278c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e8ee97-3163-4fe7-9742-dd86d8de4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:47 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Volume e7cf42d2-9663-48eb-bcb4-7c85377ff901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'volume_size': 1}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-192789708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cf42d2-9663-48eb-bcb4-7c85377ff901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Creating volume e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:25:47 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:47 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 1073741824
Sep 23 00:25:47 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:47 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 1073741824" returned: 0 in 0.819s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:47 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901
Sep 23 00:25:47 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:48 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901" returned: 0 in 0.339s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e8ee97-3163-4fe7-9742-dd86d8de4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7236d3f-5d44-40aa-852e-343ad939909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:48 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Volume volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 (e7cf42d2-9663-48eb-bcb4-7c85377ff901): created successfully
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7236d3f-5d44-40aa-852e-343ad939909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (e7e980b8-9b42-473f-bbc5-e3f2b1051ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-730445ca-e0aa-4986-b46f-954ac68376e2 tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:25:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-dfe8d07c-4d5b-4adf-b834-a3736edd1829 req-83913ac7-7bb4-4e89-9c96-2ca27f2dede7 tempest-TestInstancesWithCinderVolumes-1048714199 None] Terminate volume connection completed successfully.
Sep 23 00:25:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-dfe8d07c-4d5b-4adf-b834-a3736edd1829 req-83913ac7-7bb4-4e89-9c96-2ca27f2dede7 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deleting attachment 33115c78-836c-404b-897e-0f8040c8b0df. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:25:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "cinder-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "cinder-quobyte-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-quobyte-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47cb82-6eb7-41bf-85ea-c2c53a50b1d9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:49 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a
Sep 23 00:25:49 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:50 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a" returned: 0 in 0.836s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:50 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a
Sep 23 00:25:50 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (0bae20a7-8be2-4472-a5b0-df131393288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84ae0bb-354a-4871-ad1d-ed5c05cafbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84ae0bb-354a-4871-ad1d-ed5c05cafbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1084758166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0336e9c0-c503-425e-a503-498a29c0c4f5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e7cf42d2-9663-48eb-bcb4-7c85377ff901,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:50Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e68e621-64be-4578-83c3-8130352e7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e68e621-64be-4578-83c3-8130352e7666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88aa4b1-8fbb-4271-9782-3fed5e0793a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88aa4b1-8fbb-4271-9782-3fed5e0793a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0336e9c0-c503-425e-a503-498a29c0c4f5', 'volume_name': 'volume-0336e9c0-c503-425e-a503-498a29c0c4f5', 'volume_size': 1, 'source_volid': 'e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'source_volstatus': 'available'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fc3192-8e1c-4c45-a000-3e4c7c0dae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fc3192-8e1c-4c45-a000-3e4c7c0dae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508e1263-ec86-4b2b-8a3d-1aa8abdb1503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:50 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Volume 0336e9c0-c503-425e-a503-498a29c0c4f5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0336e9c0-c503-425e-a503-498a29c0c4f5', 'volume_size': 1, 'source_volid': 'e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'source_volstatus': 'available'}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:50 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Cloning volume e7cf42d2-9663-48eb-bcb4-7c85377ff901 to volume 0336e9c0-c503-425e-a503-498a29c0c4f5
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Creating offline snapshot c56bc558-f13c-44be-9f6f-cfff7aa6d294 of volume e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0293ac8b-d901-436e-ae5e-73a2ef9dbee2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:50 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901
Sep 23 00:25:50 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:50 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a" returned: 0 in 0.491s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-quobyte-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a" released by "delete_volume" :: held 1.424s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:50 devstack cinder-volume[87293]: WARNING cinder.quota [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1908049945-1195586337 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1908049945-1195586337, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:25:50 devstack cinder-volume[87293]: WARNING cinder.quota [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1908049945-1195586337 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1908049945-1195586337, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:25:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Created reservations ['0bfb4a40-7ee8-4671-ac6c-355e82d33b66', 'c5fc2e12-d2f1-4436-a605-7dd16eebd078', '299452a5-13d0-4f31-af53-1c7e641a34c6', 'c95d3b7d-4047-45e4-8625-c6cf4f50e66a', 'fb4fc1b6-42ef-4f8b-9ab6-5289c7ffd598'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:51 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901" returned: 0 in 0.604s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:51 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 1G
Sep 23 00:25:51 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:51 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:51 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:51 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.626s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:51 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 1G" returned: 0 in 0.745s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Deleted volume successfully.
Sep 23 00:25:51 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294
Sep 23 00:25:51 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-11e18ba7-139a-426b-8cac-e2969b389f9c tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-33d70b82-ef8c-47a0-a3b9-ef4f0004b37a-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:52 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294" returned: 0 in 0.551s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:52 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 is being set with open permissions: ugo+rw
Sep 23 00:25:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:52 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294
Sep 23 00:25:52 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:52 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294" returned: 0 in 0.353s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:52 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info
Sep 23 00:25:52 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:53 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info" returned: 0 in 0.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:53 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info is being set with open permissions: ugo+rw
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:53 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info
Sep 23 00:25:53 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:53 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.info" returned: 0 in 0.379s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-0336e9c0-c503-425e-a503-498a29c0c4f5" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-0336e9c0-c503-425e-a503-498a29c0c4f5" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] snapshot: c56bc558-f13c-44be-9f6f-cfff7aa6d294, volume: 0336e9c0-c503-425e-a503-498a29c0c4f5,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[772880c5-625d-4258-aff3-de9f68f6255a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:53 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294
Sep 23 00:25:53 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:54 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294" returned: 0 in 0.606s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f15856-7f61-4f36-b32b-0729b4a72a7d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:54 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901
Sep 23 00:25:54 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:54 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901" returned: 0 in 0.540s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:25:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:55 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5
Sep 23 00:25:55 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-2d4bd8ba-6f2b-44d2-a43a-c986bf81c39b req-c79282a4-7367-4608-a83a-37969c7bdee7 tempest-TestInstancesWithCinderVolumes-1048714199 None] Terminate volume connection completed successfully.
Sep 23 00:25:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-2d4bd8ba-6f2b-44d2-a43a-c986bf81c39b req-c79282a4-7367-4608-a83a-37969c7bdee7 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deleting attachment eaa22bb8-6ead-42bd-8b4a-c498e6a28119. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:25:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "cinder-d0d1bf35-39ac-41bd-b821-9a6bfcb300db-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-d0d1bf35-39ac-41bd-b821-9a6bfcb300db-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "cinder-quobyte-d0d1bf35-39ac-41bd-b821-9a6bfcb300db" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-quobyte-d0d1bf35-39ac-41bd-b821-9a6bfcb300db" acquired by "delete_volume" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:56 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[333eaa3d-7295-4082-be8f-6a901e9e3831]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:56 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db
Sep 23 00:25:56 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:57 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db" returned: 0 in 1.020s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:57 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db
Sep 23 00:25:57 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:57 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d0d1bf35-39ac-41bd-b821-9a6bfcb300db" returned: 0 in 0.713s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-quobyte-d0d1bf35-39ac-41bd-b821-9a6bfcb300db" released by "delete_volume" :: held 1.904s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:58 devstack cinder-volume[87293]: WARNING cinder.quota [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1064615801-750672379 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1064615801-750672379, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:25:58 devstack cinder-volume[87293]: WARNING cinder.quota [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1064615801-750672379 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1064615801-750672379, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Created reservations ['bd1a7ce8-6c4b-4394-b19b-5a983e997317', 'e4e634ff-1d19-4da8-9253-f6d1736a4bd4', '96e1696a-96fc-4e71-a9d9-6296e645606a', 'd2ac2f94-b929-4373-8244-e62680419ad7', '7eb3ef28-bdaa-4571-8920-e08fa4d5dc7b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:58 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:25:58 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:59 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.869s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:59 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deleted volume successfully.
Sep 23 00:25:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-78cff128-b56d-4eba-9836-07dc527c4d23 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-d0d1bf35-39ac-41bd-b821-9a6bfcb300db-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:05 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5" returned: 0 in 10.600s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901, size 1024.00 MB, duration 10.60 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:26:05 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Converted 1024.00 MB image at 96.59 MB/s
Sep 23 00:26:05 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 is being set with open permissions: ugo+rw
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:05 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5
Sep 23 00:26:05 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:05 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5" returned: 0 in 0.363s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-0336e9c0-c503-425e-a503-498a29c0c4f5" released by "_copy_volume_from_snapshot" :: held 12.290s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-c56bc558-f13c-44be-9f6f-cfff7aa6d294" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-c56bc558-f13c-44be-9f6f-cfff7aa6d294" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Deleting offline snapshot c56bc558-f13c-44be-9f6f-cfff7aa6d294 of volume e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] snapshot_file for this snap is: volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f8415-9fc4-4d1b-93c2-44f74ff6e7fd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:06 devstack sudo[100433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294
Sep 23 00:26:06 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:06 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294" returned: 0 in 0.561s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[de79d39b-ca6a-4896-bd92-8f43303c3f31]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:06 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901
Sep 23 00:26:06 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:07 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901" returned: 0 in 0.820s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:07 devstack sudo[100444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294
Sep 23 00:26:07 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:07 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294" returned: 0 in 0.522s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:08 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294
Sep 23 00:26:08 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:08 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901.c56bc558-f13c-44be-9f6f-cfff7aa6d294" returned: 0 in 0.411s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-c56bc558-f13c-44be-9f6f-cfff7aa6d294" released by "_delete_snapshot" :: held 2.465s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.198s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508e1263-ec86-4b2b-8a3d-1aa8abdb1503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0336e9c0-c503-425e-a503-498a29c0c4f5', 'volume_size': 1, 'source_volid': 'e7cf42d2-9663-48eb-bcb4-7c85377ff901', 'source_volstatus': 'available'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1063cab-1840-425d-aba4-539b105ff1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:08 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Volume volume-0336e9c0-c503-425e-a503-498a29c0c4f5 (0336e9c0-c503-425e-a503-498a29c0c4f5): created successfully
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1063cab-1840-425d-aba4-539b105ff1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (0bae20a7-8be2-4472-a5b0-df131393288e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3319e90a-908a-4ab3-a20e-2b3cd57172e3 tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:26:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-122de002-2d81-4337-ac6f-c72d33fe7cb1 req-c12a1d88-77d0-455b-811d-37ad297437fe tempest-TestInstancesWithCinderVolumes-1048714199 None] Terminate volume connection completed successfully.
Sep 23 00:26:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-122de002-2d81-4337-ac6f-c72d33fe7cb1 req-c12a1d88-77d0-455b-811d-37ad297437fe tempest-TestInstancesWithCinderVolumes-1048714199 None] Deleting attachment 1abf91d1-744b-4cce-848e-f89d17620c86. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:26:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "cinder-98cb6eb8-05db-4049-8b2f-97d06305dc7a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-98cb6eb8-05db-4049-8b2f-97d06305dc7a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "cinder-quobyte-98cb6eb8-05db-4049-8b2f-97d06305dc7a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-quobyte-98cb6eb8-05db-4049-8b2f-97d06305dc7a" acquired by "delete_volume" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4620d1-d19c-418f-bf51-cb12b09f6b3a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Flow 'volume_create_manager' (083d9ab3-c311-4d91-b280-cf8327f84727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6703afe0-1dce-4c61-a864-0b287c79f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6703afe0-1dce-4c61-a864-0b287c79f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2049043096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a0b438-4089-4553-8936-614554c6626e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4df27aa8e4458c8105d11535f93a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:11Z,use_quota=True,user_id='d0c26b3a3531472993319f2c618db409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a
Sep 23 00:26:11 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfab6018-a6e9-4e82-b0c8-88f639d1c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfab6018-a6e9-4e82-b0c8-88f639d1c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcdf727-051d-4cce-89e4-e61d8f7fa63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcdf727-051d-4cce-89e4-e61d8f7fa63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a0b438-4089-4553-8936-614554c6626e', 'volume_name': 'volume-70a0b438-4089-4553-8936-614554c6626e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233a344f-b928-40ff-9f25-788ba29879a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233a344f-b928-40ff-9f25-788ba29879a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219ac625-aa80-4c7a-a1db-1d27166b05a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Volume 70a0b438-4089-4553-8936-614554c6626e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a0b438-4089-4553-8936-614554c6626e', 'volume_size': 1}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2049043096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a0b438-4089-4553-8936-614554c6626e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4df27aa8e4458c8105d11535f93a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:11Z,use_quota=True,user_id='d0c26b3a3531472993319f2c618db409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Creating volume 70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:26:11 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:11 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e 1073741824
Sep 23 00:26:11 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (9ccbcb25-a862-49db-8e8b-7388d26e4815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aadfd4-9c53-45d6-9fee-b5006ecaaed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aadfd4-9c53-45d6-9fee-b5006ecaaed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073975827',display_name='tempest-VolumesGetTest-Volume-1628049686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:11Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1d0dc7-0860-4068-b9da-3831a31676ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1d0dc7-0860-4068-b9da-3831a31676ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863c6c65-8bf6-4f90-b67f-eb5d74c2774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863c6c65-8bf6-4f90-b67f-eb5d74c2774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63dc3b7-54d7-4a81-85e8-1fba8fba8ac6', 'volume_name': 'volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56590f15-2f7f-432e-9738-11b9cd6d4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56590f15-2f7f-432e-9738-11b9cd6d4214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4324bee1-8b61-4d47-a6e9-ff84a34a3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:11 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Volume d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6', 'volume_size': 1}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:11 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a" returned: 0 in 0.498s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:11 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a
Sep 23 00:26:11 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:11 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-98cb6eb8-05db-4049-8b2f-97d06305dc7a" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-quobyte-98cb6eb8-05db-4049-8b2f-97d06305dc7a" released by "delete_volume" :: held 0.981s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:11 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e 1073741824" returned: 0 in 0.689s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:11 devstack cinder-volume[87293]: WARNING cinder.quota [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875345583-300062244 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875345583-300062244, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:26:11 devstack cinder-volume[87293]: WARNING cinder.quota [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875345583-300062244 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875345583-300062244, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:12 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e
Sep 23 00:26:12 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Created reservations ['6ab01d11-e581-4469-8feb-2cd4bc59328e', 'c1304227-2817-4012-97d7-71d5d2bbb10d', 'c52ce677-b106-446c-b6d6-44f807e907f4', '4046c027-c8a3-4004-88a7-51c6e4fe3537', 'f57e3491-7e3d-4908-afe2-2a81eb270c45'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:12 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:26:12 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:12 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e" returned: 0 in 0.627s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073975827',display_name='tempest-VolumesGetTest-Volume-1628049686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:11Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Creating volume d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:26:12 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:12 devstack sudo[100483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 1073741824
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219ac625-aa80-4c7a-a1db-1d27166b05a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a0b438-4089-4553-8936-614554c6626e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:12 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad1576f-fd52-458b-95c8-4cd9bf34a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Volume volume-70a0b438-4089-4553-8936-614554c6626e (70a0b438-4089-4553-8936-614554c6626e): created successfully
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad1576f-fd52-458b-95c8-4cd9bf34a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Flow 'volume_create_manager' (083d9ab3-c311-4d91-b280-cf8327f84727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-68903d7d-1b49-486c-919b-96261f6c4cdb tempest-TestImageHashVerification-291273432 None] Created volume successfully.
Sep 23 00:26:12 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.530s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Deleted volume successfully.
Sep 23 00:26:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-fc639466-bf28-41d6-9554-39ce8e4a6b54 tempest-TestInstancesWithCinderVolumes-1048714199 None] Lock "cinder-98cb6eb8-05db-4049-8b2f-97d06305dc7a-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:13 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 1073741824" returned: 0 in 0.860s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:13 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6
Sep 23 00:26:13 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:14 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6" returned: 0 in 0.397s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4324bee1-8b61-4d47-a6e9-ff84a34a3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3df792-92e5-46da-a07e-fc05be58d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Volume volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 (d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6): created successfully
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3df792-92e5-46da-a07e-fc05be58d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (9ccbcb25-a862-49db-8e8b-7388d26e4815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b94de34c-2ba5-46f6-8940-1e8c9310031f tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Lock "cinder-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e02c10-4ccc-4de8-bddc-8b895d98d93e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d5ad4-3de1-4e31-b22e-7999672ba905]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:15 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6
Sep 23 00:26:15 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:15 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e
Sep 23 00:26:15 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:15 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e" returned: 0 in 0.565s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[672180f1-fd9b-4e52-ada2-a8e2cd54faee]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:15 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6" returned: 0 in 0.653s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:15 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6
Sep 23 00:26:15 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:15 devstack sudo[100532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e
Sep 23 00:26:15 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:16 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6" returned: 0 in 0.437s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6" released by "delete_volume" :: held 1.177s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Created reservations ['fbd47130-e7c6-44b6-8dc7-9843133ec601', '83c9013a-46da-439d-aec8-83fd55514fab', '3be89e16-bd38-49d9-b893-16c521f45c06', 'b0833c44-6fe6-40f2-9404-aef20575904e', '7c7d2b05-d08e-4c9a-b4d2-a9201a62402c'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:26:16 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e" returned: 0 in 0.570s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e /opt/stack/data/cinder/conversion/70a0b438-4089-4553-8936-614554c6626e.temp_image.d5b5f454-6faa-4687-ad08-3f2ba9107348wn8b8qf5.img {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:16 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e /opt/stack/data/cinder/conversion/70a0b438-4089-4553-8936-614554c6626e.temp_image.d5b5f454-6faa-4687-ad08-3f2ba9107348wn8b8qf5.img
Sep 23 00:26:16 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:16 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:26:16 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:17 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.664s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:17 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:26:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ad9eada3-ae17-40b6-8a0c-82341c5dde19 tempest-VolumesGetTest-1860593986 None] Lock "cinder-d63dc3b7-54d7-4a81-85e8-1fba8fba8ac6-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-0336e9c0-c503-425e-a503-498a29c0c4f5-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Lock "cinder-0336e9c0-c503-425e-a503-498a29c0c4f5-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-0336e9c0-c503-425e-a503-498a29c0c4f5" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-0336e9c0-c503-425e-a503-498a29c0c4f5" acquired by "delete_volume" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:18 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b95b266-aab6-4ca4-bd2c-7dcafc59b94c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:18 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5
Sep 23 00:26:18 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:19 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5" returned: 0 in 1.194s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:19 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5
Sep 23 00:26:19 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:21 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0336e9c0-c503-425e-a503-498a29c0c4f5" returned: 0 in 1.503s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-0336e9c0-c503-425e-a503-498a29c0c4f5" released by "delete_volume" :: held 2.899s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Created reservations ['e5914200-2d2d-4a41-9029-1afea9c2dda2', 'b0576f30-6ecc-485d-ad13-cc84f1c8d734', '8bbfbc05-4e0a-454e-9fde-42244dd95e53', 'b1149399-9d72-4c2c-a263-c7d2004c7696', '171a1f51-3324-4cbd-9ff7-72f1b5d0d283'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:21 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:26:21 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-e7cf42d2-9663-48eb-bcb4-7c85377ff901-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Lock "cinder-e7cf42d2-9663-48eb-bcb4-7c85377ff901-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-e7cf42d2-9663-48eb-bcb4-7c85377ff901" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-e7cf42d2-9663-48eb-bcb4-7c85377ff901" acquired by "delete_volume" :: waited 0.047s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:22 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 1.046s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ef1b2-986c-4173-851d-3fa7cda1da91]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4f9034cc-ee82-456c-b726-6acec29000db tempest-VolumesGetTest-1860593986 None] Lock "cinder-0336e9c0-c503-425e-a503-498a29c0c4f5-delete_volume" released by "delete_volume" :: held 4.958s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:23 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901
Sep 23 00:26:23 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:23 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901" returned: 0 in 1.212s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:24 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901
Sep 23 00:26:24 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:24 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-e7cf42d2-9663-48eb-bcb4-7c85377ff901" returned: 0 in 0.878s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-e7cf42d2-9663-48eb-bcb4-7c85377ff901" released by "delete_volume" :: held 2.356s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Created reservations ['e390a6b0-8c90-4ef4-97f7-275fab8cbd0a', '0f301b58-6b25-4684-a3ef-2717a04d9fb6', '7b45919c-e34a-44ae-a491-3ab2a1a16575', '9dba1a7d-0fd5-4b3a-92e0-8c4234b92ed3', '010ea2fd-8472-4ada-be2e-6efb9805cefe'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=93,cinder:SELECT=72,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:25 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:26:25 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:26 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 1.004s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:26 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:26:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e7bceccd-a8ad-4078-b92d-27d5ffc38284 tempest-VolumesGetTest-1860593986 None] Lock "cinder-e7cf42d2-9663-48eb-bcb4-7c85377ff901-delete_volume" released by "delete_volume" :: held 4.241s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=88,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Flow 'volume_create_manager' (2066bcb9-1d13-497d-b224-c92b8c6b32da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b9724-29ee-47fb-986c-46ffc0e5151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b9724-29ee-47fb-986c-46ffc0e5151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-896702364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a4d4fe-501e-45dd-b8e6-593ae026cc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3803f5e21b1c41c49d3941ba41d9cc0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:28Z,use_quota=True,user_id='efcb09299f40406ebf00ff507b7aba65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324d2ebd-abc8-459d-a1ab-5df29da8128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324d2ebd-abc8-459d-a1ab-5df29da8128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c5844-e3bb-4cba-858b-fcd5c19f779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c5844-e3bb-4cba-858b-fcd5c19f779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a4d4fe-501e-45dd-b8e6-593ae026cc3b', 'volume_name': 'volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0c0b0e-eef6-4d06-ad00-d087c1059269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0c0b0e-eef6-4d06-ad00-d087c1059269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4642b20-afaa-4f74-9c14-4aa8d06d8987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:28 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Volume c1a4d4fe-501e-45dd-b8e6-593ae026cc3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b', 'volume_size': 1}
Sep 23 00:26:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (0eb88aa3-ecf3-4dab-9b02-3c41bbcf4c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68799e7-4f02-4671-bd0d-bbc23a128729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68799e7-4f02-4671-bd0d-bbc23a128729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1274595716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8852b0a-47d6-4958-8f7d-c20dd12c6c61,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:29Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97857ecd-a7f1-4ba0-8b08-d0f21617e563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97857ecd-a7f1-4ba0-8b08-d0f21617e563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec16dd02-8e33-4be9-b15d-c132a583d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:26:29 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e /opt/stack/data/cinder/conversion/70a0b438-4089-4553-8936-614554c6626e.temp_image.d5b5f454-6faa-4687-ad08-3f2ba9107348wn8b8qf5.img" returned: 0 in 13.423s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91f6c6-50dc-4747-a5ba-4a355b371760]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:29 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e
Sep 23 00:26:29 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec16dd02-8e33-4be9-b15d-c132a583d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8852b0a-47d6-4958-8f7d-c20dd12c6c61', 'volume_name': 'volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4bacdd0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de632ca-900e-458e-ba75-07fdbac330a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de632ca-900e-458e-ba75-07fdbac330a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5f3c97-fe08-471e-8173-08b9f9bd5c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Volume c8852b0a-47d6-4958-8f7d-c20dd12c6c61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4bacdd0>}
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Trying to clone c8852b0a-47d6-4958-8f7d-c20dd12c6c61 from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:26:30 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e" returned: 0 in 0.867s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e, size 1024.00 MB, duration 13.42 sec, destination /opt/stack/data/cinder/conversion/70a0b438-4089-4553-8936-614554c6626e.temp_image.d5b5f454-6faa-4687-ad08-3f2ba9107348wn8b8qf5.img {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:26:30 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Converted 1024.00 MB image at 76.28 MB/s
Sep 23 00:26:30 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] d5b5f454-6faa-4687-ad08-3f2ba9107348 was raw, no need to convert to raw {{(pid=87293) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:26:31 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0e257-39aa-4b69-bc6c-68cd1022c081]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:31 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD
Sep 23 00:26:31 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:31 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c is fetched for user 881400983ebb41eabf6fa5f3ec824eed. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8216407-cdf1-4a98-9dc3-8d50ceae4246]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:32 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD
Sep 23 00:26:32 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:32 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD" returned: 0 in 0.515s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:40 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:26:40 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:40 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:26:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:26:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:26:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:DELETE=1,cinder:UPDATE=2,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:26:45 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.564s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Uploaded volume to glance image-id: d5b5f454-6faa-4687-ad08-3f2ba9107348. {{(pid=87293) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.657s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-896702364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a4d4fe-501e-45dd-b8e6-593ae026cc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3803f5e21b1c41c49d3941ba41d9cc0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:28Z,use_quota=True,user_id='efcb09299f40406ebf00ff507b7aba65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Creating volume c1a4d4fe-501e-45dd-b8e6-593ae026cc3b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:26:57 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:26:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:57 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b 1073741824
Sep 23 00:26:57 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2871a4cf-303c-459b-855c-b492a1bef3cf tempest-TestImageHashVerification-291273432 None] Copy volume to image completed successfully.
Sep 23 00:26:58 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b 1073741824" returned: 0 in 0.593s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:58 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b
Sep 23 00:26:58 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:58 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b" returned: 0 in 0.348s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.463s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1274595716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8852b0a-47d6-4958-8f7d-c20dd12c6c61,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:29Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Creating volume c8852b0a-47d6-4958-8f7d-c20dd12c6c61 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:26:58 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:58 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 1073741824
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4642b20-afaa-4f74-9c14-4aa8d06d8987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:58 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaa1362-63e7-4e2c-85c7-8bffc4703f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Volume volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b (c1a4d4fe-501e-45dd-b8e6-593ae026cc3b): created successfully
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaa1362-63e7-4e2c-85c7-8bffc4703f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Flow 'volume_create_manager' (2066bcb9-1d13-497d-b224-c92b8c6b32da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a868ca17-8920-484a-b2c6-684a77b88785 tempest-TestMinimumBasicScenario-1605113421 None] Created volume successfully.
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Acquiring lock "cinder-70a0b438-4089-4553-8936-614554c6626e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Lock "cinder-70a0b438-4089-4553-8936-614554c6626e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Acquiring lock "cinder-quobyte-70a0b438-4089-4553-8936-614554c6626e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Lock "cinder-quobyte-70a0b438-4089-4553-8936-614554c6626e" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af459aa4-3093-4c0a-a7b4-999f305e9755]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:59 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e
Sep 23 00:26:59 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:59 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 1073741824" returned: 0 in 0.721s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:59 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61
Sep 23 00:26:59 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:59 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e" returned: 0 in 0.559s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:59 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e
Sep 23 00:26:59 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:59 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:26:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Attempting download of d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume c8852b0a-47d6-4958-8f7d-c20dd12c6c61. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c8bb10-8a3b-42d6-b40d-26a2ab0fa63f]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:00 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-70a0b438-4089-4553-8936-614554c6626e" returned: 0 in 0.382s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Lock "cinder-quobyte-70a0b438-4089-4553-8936-614554c6626e" released by "delete_volume" :: held 1.007s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:00 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve
Sep 23 00:27:00 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Created reservations ['0231c7a3-2a0f-4c7b-81e9-5142e73a2c79', 'f350e7cf-0396-4a7b-9030-c950018648df', '2d790d5f-6e6f-4093-a6b2-c2dc6be4567a', 'cc214dc7-4ff5-4d79-b7f1-ae3b155dba57', 'd6129cca-4d28-4d39-9804-5083c1490ddf'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:00 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:00 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:00 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:00 devstack sudo[100779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve
Sep 23 00:27:00 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:00 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.419s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Deleted volume successfully.
Sep 23 00:27:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-554d6938-8dc7-4c3d-8e5c-8f75f182a316 tempest-TestImageHashVerification-291273432 None] Lock "cinder-70a0b438-4089-4553-8936-614554c6626e-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:01 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve" returned: 1 in 0.531s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_vyrps3ve' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58efc1-b675-43ae-bcc2-d03fa82895d7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-47453c8b-b5b1-49dc-80d7-d6c22f6b08c3 req-24d33e32-60c9-4c91-b119-ab43ed41e81b tempest-TestMinimumBasicScenario-1605113421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-47453c8b-b5b1-49dc-80d7-d6c22f6b08c3 req-24d33e32-60c9-4c91-b119-ab43ed41e81b tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-47453c8b-b5b1-49dc-80d7-d6c22f6b08c3 req-24d33e32-60c9-4c91-b119-ab43ed41e81b tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:01 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD
Sep 23 00:27:01 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-47453c8b-b5b1-49dc-80d7-d6c22f6b08c3 req-24d33e32-60c9-4c91-b119-ab43ed41e81b tempest-TestMinimumBasicScenario-1605113421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da6fd918-19b1-4c5a-a762-b886a948a793', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:27:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-47453c8b-b5b1-49dc-80d7-d6c22f6b08c3 req-24d33e32-60c9-4c91-b119-ab43ed41e81b tempest-TestMinimumBasicScenario-1605113421 None] attachment_update completed successfully.
Sep 23 00:27:01 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD" returned: 0 in 0.618s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] d3316061-b3c0-4b6e-8b31-c56fbf284d8c was qcow2, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:27:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:01 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61
Sep 23 00:27:01 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:04 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" returned: 0 in 2.883s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:04 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_tz99an50devstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:27:04 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Converted 112.00 MB image at 38.81 MB/s
Sep 23 00:27:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:04 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 1G
Sep 23 00:27:04 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:05 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 1G" returned: 0 in 0.448s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Downloaded image d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume c8852b0a-47d6-4958-8f7d-c20dd12c6c61 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c for user 881400983ebb41eabf6fa5f3ec824eed is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Marking volume c8852b0a-47d6-4958-8f7d-c20dd12c6c61 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Copying metadata from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c to c8852b0a-47d6-4958-8f7d-c20dd12c6c61. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Creating volume glance metadata for volume c8852b0a-47d6-4958-8f7d-c20dd12c6c61 backed by image d3316061-b3c0-4b6e-8b31-c56fbf284d8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5f3c97-fe08-471e-8173-08b9f9bd5c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4bacdd0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3f8e0e-7ba0-4595-951d-b1543d556f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Volume volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 (c8852b0a-47d6-4958-8f7d-c20dd12c6c61): created successfully
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3f8e0e-7ba0-4595-951d-b1543d556f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (0eb88aa3-ecf3-4dab-9b02-3c41bbcf4c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-362353d8-f236-4757-96fd-b32cbbe1a580 tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (777014ef-8940-4566-88a6-3660c34e3beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a3212b-a7ba-4ba5-8eca-e5261970b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a3212b-a7ba-4ba5-8eca-e5261970b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2095436110',display_name='tempest-VolumesGetTest-Volume-1148019921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7364e6f0-3661-4e5c-b6e9-dfb7bda7014a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:07Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1f7f62-c6bd-4b81-a943-5063362e044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1f7f62-c6bd-4b81-a943-5063362e044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cc380b-50e5-407d-8773-e85d110c8e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cc380b-50e5-407d-8773-e85d110c8e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7364e6f0-3661-4e5c-b6e9-dfb7bda7014a', 'volume_name': 'volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a14cc-7c1c-49dc-b34a-951fcfee5b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a14cc-7c1c-49dc-b34a-951fcfee5b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fe7e44-0ae3-491d-aee0-27ee9d11923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:07 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Volume 7364e6f0-3661-4e5c-b6e9-dfb7bda7014a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a', 'volume_size': 1}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2095436110',display_name='tempest-VolumesGetTest-Volume-1148019921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7364e6f0-3661-4e5c-b6e9-dfb7bda7014a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76231f629b8d4ecc87642480304ecc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:07Z,use_quota=True,user_id='881400983ebb41eabf6fa5f3ec824eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Creating volume 7364e6f0-3661-4e5c-b6e9-dfb7bda7014a {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:07 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:07 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a 1073741824
Sep 23 00:27:07 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:08 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a 1073741824" returned: 0 in 0.754s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:08 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a
Sep 23 00:27:08 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:08 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a" returned: 0 in 0.348s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fe7e44-0ae3-491d-aee0-27ee9d11923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0625744a-5444-42ff-b018-c7e9f66ba661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:08 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Volume volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a (7364e6f0-3661-4e5c-b6e9-dfb7bda7014a): created successfully
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0625744a-5444-42ff-b018-c7e9f66ba661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Flow 'volume_create_manager' (777014ef-8940-4566-88a6-3660c34e3beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e895bf08-6aa9-4819-81f9-59aa0acdac1c tempest-VolumesGetTest-1860593986 None] Created volume successfully.
Sep 23 00:27:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:09 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8059d00c-d456-45b8-b790-535bd9ed21cd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:10 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a
Sep 23 00:27:10 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:10 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a" returned: 0 in 0.522s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:10 devstack sudo[101241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a
Sep 23 00:27:10 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:10 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a" returned: 0 in 0.503s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a" released by "delete_volume" :: held 1.100s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Created reservations ['da87f9bc-0c5d-49e2-a73a-1365d901af87', '470af3d4-b5d2-48fd-bed3-34e588b05ca0', '25e79e93-4cc6-4e7d-9047-811d50dad464', 'c4f240b8-1057-499f-84fc-6cfec42459da', '9a8ccea6-8b32-4332-adaf-6a25801a0c37'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:11 devstack sudo[101244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:11 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:11 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:27:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b4eaec1-f551-46ee-8b3b-5980adbde9f0 tempest-VolumesGetTest-1860593986 None] Lock "cinder-7364e6f0-3661-4e5c-b6e9-dfb7bda7014a-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-c8852b0a-47d6-4958-8f7d-c20dd12c6c61-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Lock "cinder-c8852b0a-47d6-4958-8f7d-c20dd12c6c61-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Acquiring lock "cinder-quobyte-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:12 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e4e352-df9f-493c-b743-49f20c1a5840]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:12 devstack sudo[101249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61
Sep 23 00:27:12 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:13 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" returned: 0 in 0.654s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:13 devstack sudo[101260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61
Sep 23 00:27:13 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:13 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" returned: 0 in 0.527s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Lock "cinder-quobyte-c8852b0a-47d6-4958-8f7d-c20dd12c6c61" released by "delete_volume" :: held 1.254s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Created reservations ['924a5674-4aa9-458c-a4b6-8572f946925b', '8b2078be-1bdf-4408-8087-c2ba18dece20', '9fa1a829-7d59-4030-bdcf-0530fc3dc45a', '5250bdcd-8ab3-42ff-acac-d3389abe40c8', '85aad68e-007b-4ea4-9974-1bb0197f723a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:13 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:13 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:14 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.376s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:14 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Deleted volume successfully.
Sep 23 00:27:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8c622e88-f2d6-42e2-bd9e-e48e7f8bebae tempest-VolumesGetTest-1860593986 None] Lock "cinder-c8852b0a-47d6-4958-8f7d-c20dd12c6c61-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:23 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=42,cinder:SELECT=38,cinder:INSERT=14,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:27:24 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (2aa2865d-e90a-47b2-840b-8f3f913350d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe296f6-58cb-45c3-8400-1f82fbc0b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe296f6-58cb-45c3-8400-1f82fbc0b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-427928838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fb3f21-5bcf-414c-ac81-7bf79844b266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8606c2-82fb-40d1-b6af-fef9910a081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8606c2-82fb-40d1-b6af-fef9910a081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789c4821-4304-489c-a33e-31e58491a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789c4821-4304-489c-a33e-31e58491a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fb3f21-5bcf-414c-ac81-7bf79844b266', 'volume_name': 'volume-04fb3f21-5bcf-414c-ac81-7bf79844b266', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3438566-dec2-4e20-b06c-a06d3a072925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3438566-dec2-4e20-b06c-a06d3a072925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7322c1-8f64-41cb-8a7e-62f931953a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume 04fb3f21-5bcf-414c-ac81-7bf79844b266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fb3f21-5bcf-414c-ac81-7bf79844b266', 'volume_size': 1}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-427928838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fb3f21-5bcf-414c-ac81-7bf79844b266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Creating volume 04fb3f21-5bcf-414c-ac81-7bf79844b266 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:25 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:25 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 1073741824
Sep 23 00:27:25 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:26 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 1073741824" returned: 0 in 0.753s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:26 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266
Sep 23 00:27:26 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:27 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266" returned: 0 in 0.415s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7322c1-8f64-41cb-8a7e-62f931953a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fb3f21-5bcf-414c-ac81-7bf79844b266', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f1be05-1ade-4c0e-8e70-c1790abe2d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:27 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 (04fb3f21-5bcf-414c-ac81-7bf79844b266): created successfully
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f1be05-1ade-4c0e-8e70-c1790abe2d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (2aa2865d-e90a-47b2-840b-8f3f913350d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f120b8e2-cf05-43c4-b551-a5ea80c35d52 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created volume successfully.
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Flow 'volume_create_manager' (49c30fda-ceb7-4787-ab8e-d49096a5ef5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06684b67-2e4c-4366-9122-eb12c4ac0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06684b67-2e4c-4366-9122-eb12c4ac0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2131392888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd897a44-f98f-4a8f-94d3-6936257bce8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f78bafebd354457a048414cb8aa6f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:28Z,use_quota=True,user_id='cab8cfc1afe94199a36081e1dac45d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ff6006-3c7c-408a-a0b7-8dc520d2fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ff6006-3c7c-408a-a0b7-8dc520d2fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11090db8-6e92-4f21-b31e-0e5a57e1e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11090db8-6e92-4f21-b31e-0e5a57e1e694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd897a44-f98f-4a8f-94d3-6936257bce8c', 'volume_name': 'volume-fd897a44-f98f-4a8f-94d3-6936257bce8c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072baffd-6948-40ee-acb2-e47c442e29ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072baffd-6948-40ee-acb2-e47c442e29ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9c1fe7-db7e-472c-9929-c284b4bcf5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:28 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Volume fd897a44-f98f-4a8f-94d3-6936257bce8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd897a44-f98f-4a8f-94d3-6936257bce8c', 'volume_size': 1}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2131392888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd897a44-f98f-4a8f-94d3-6936257bce8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f78bafebd354457a048414cb8aa6f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:28Z,use_quota=True,user_id='cab8cfc1afe94199a36081e1dac45d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Creating volume fd897a44-f98f-4a8f-94d3-6936257bce8c {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:28 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:28 devstack sudo[101369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c 1073741824
Sep 23 00:27:28 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (413292c4-9998-451c-b73d-988b76456380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a132f368-301b-46e9-ad2e-52cf7da3737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a132f368-301b-46e9-ad2e-52cf7da3737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306059899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542b0698-5cbd-46fe-85fb-71de8b5bb1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:29Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789ad3b2-4afc-4067-9eeb-1db7dd22759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789ad3b2-4afc-4067-9eeb-1db7dd22759a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07da8deb-b35c-40e8-88e9-7807973d9a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07da8deb-b35c-40e8-88e9-7807973d9a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542b0698-5cbd-46fe-85fb-71de8b5bb1a6', 'volume_name': 'volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2f5b98-5976-4074-9d4a-ceb1d009b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2f5b98-5976-4074-9d4a-ceb1d009b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43922e67-59c3-48c7-beed-8c47d3d24dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume 542b0698-5cbd-46fe-85fb-71de8b5bb1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6', 'volume_size': 1}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (f937bf9a-5e39-4d66-a99e-f09cac5553c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94740134-3579-4afd-8d17-d49aaf868764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94740134-3579-4afd-8d17-d49aaf868764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506888331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccaeab0-f84e-4992-a955-9a6e334a7387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:30Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86d1d0d-71e2-460a-982f-ecc5277b7228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86d1d0d-71e2-460a-982f-ecc5277b7228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd62d14-64f3-4e03-b514-df5f13eb9d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd62d14-64f3-4e03-b514-df5f13eb9d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccaeab0-f84e-4992-a955-9a6e334a7387', 'volume_name': 'volume-9ccaeab0-f84e-4992-a955-9a6e334a7387', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1aefdf-49cc-4446-bf3b-18cd3ac8e25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1aefdf-49cc-4446-bf3b-18cd3ac8e25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb91657-3534-47b5-9203-10137899c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume 9ccaeab0-f84e-4992-a955-9a6e334a7387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccaeab0-f84e-4992-a955-9a6e334a7387', 'volume_size': 1}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:30 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c 1073741824" returned: 0 in 1.209s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:30 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c
Sep 23 00:27:30 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:30 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c" returned: 0 in 0.831s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.764s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306059899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542b0698-5cbd-46fe-85fb-71de8b5bb1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:29Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Creating volume 542b0698-5cbd-46fe-85fb-71de8b5bb1a6 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:31 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9c1fe7-db7e-472c-9929-c284b4bcf5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd897a44-f98f-4a8f-94d3-6936257bce8c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 1073741824
Sep 23 00:27:31 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04368d7-4181-4fa4-afda-3aa7f77a7483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Volume volume-fd897a44-f98f-4a8f-94d3-6936257bce8c (fd897a44-f98f-4a8f-94d3-6936257bce8c): created successfully
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04368d7-4181-4fa4-afda-3aa7f77a7483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Flow 'volume_create_manager' (49c30fda-ceb7-4787-ab8e-d49096a5ef5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4c823d8b-6c28-41e7-b16b-3a034212b970 tempest-VolumesListTestJSON-1732215027 None] Created volume successfully.
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (2c276ff4-da40-4e93-ae84-25d358224327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a70da-1747-4573-950f-021d59e03e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a70da-1747-4573-950f-021d59e03e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-94802822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d7ae55-4b88-4a2a-b395-4e8373823ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:31Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35068c5-5a75-4e53-a13d-00436f79df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35068c5-5a75-4e53-a13d-00436f79df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8faf32a-73e7-408c-bd67-6fd95ebdca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8faf32a-73e7-408c-bd67-6fd95ebdca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d7ae55-4b88-4a2a-b395-4e8373823ae2', 'volume_name': 'volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773ff75f-5417-400c-b5b6-c0959eb6877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773ff75f-5417-400c-b5b6-c0959eb6877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8430c416-c9df-4117-80b8-281c8820fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume f4d7ae55-4b88-4a2a-b395-4e8373823ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2', 'volume_size': 1}
Sep 23 00:27:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:32 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 1073741824" returned: 0 in 1.255s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:32 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6
Sep 23 00:27:32 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:33 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6" returned: 0 in 0.842s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.184s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506888331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccaeab0-f84e-4992-a955-9a6e334a7387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:30Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Creating volume 9ccaeab0-f84e-4992-a955-9a6e334a7387 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:33 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:33 devstack sudo[101485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 1073741824
Sep 23 00:27:33 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43922e67-59c3-48c7-beed-8c47d3d24dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d454184a-805e-4ffc-9c24-57f93594f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (ecd62f1f-0b03-41ef-8b9e-e6176e5e2c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4996de12-21a6-4df6-8a31-ce99bc7c9178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 (542b0698-5cbd-46fe-85fb-71de8b5bb1a6): created successfully
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d454184a-805e-4ffc-9c24-57f93594f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (413292c4-9998-451c-b73d-988b76456380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4996de12-21a6-4df6-8a31-ce99bc7c9178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235278685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3a625d-b56d-4344-abac-92bda2b88dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c50e67-08c3-43dd-8fa2-caf1c1695fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c50e67-08c3-43dd-8fa2-caf1c1695fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d57a6af-b8c5-47a8-b6eb-4a963f6759a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d57a6af-b8c5-47a8-b6eb-4a963f6759a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3a625d-b56d-4344-abac-92bda2b88dcc', 'volume_name': 'volume-fd3a625d-b56d-4344-abac-92bda2b88dcc', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce439ae2-ceb4-4a3f-bf3f-85c4f443cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce439ae2-ceb4-4a3f-bf3f-85c4f443cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e1bc0a-671d-42f2-a97c-88b75a2a401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume fd3a625d-b56d-4344-abac-92bda2b88dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3a625d-b56d-4344-abac-92bda2b88dcc', 'volume_size': 1}
Sep 23 00:27:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-72abd180-d409-4e84-8db9-3927d541a12a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created volume successfully.
Sep 23 00:27:34 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 1073741824" returned: 0 in 1.236s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:34 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387
Sep 23 00:27:34 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Flow 'volume_create_manager' (16e57235-6d96-4837-b9f2-6611cdaa85f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38c74f0-b533-4a91-be9f-f09b8ee3f89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38c74f0-b533-4a91-be9f-f09b8ee3f89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1933392951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f24e4b6-0621-4d3b-912f-a364ae67d3e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f78bafebd354457a048414cb8aa6f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:35Z,use_quota=True,user_id='cab8cfc1afe94199a36081e1dac45d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6a676-eab3-48e2-9e66-28ad20a14a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6a676-eab3-48e2-9e66-28ad20a14a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff78cf70-0dfa-4389-9edf-6d5116891b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff78cf70-0dfa-4389-9edf-6d5116891b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f24e4b6-0621-4d3b-912f-a364ae67d3e2', 'volume_name': 'volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf62948-0915-4490-9b8c-c0534b0da0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf62948-0915-4490-9b8c-c0534b0da0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321488e1-d21f-43ef-b85b-053a4623b641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Volume 1f24e4b6-0621-4d3b-912f-a364ae67d3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2', 'volume_size': 1}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:35 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (61a2622f-106f-41fd-ae85-0255578e3162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dc586b-1077-4674-ab81-c58235a6893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387" returned: 0 in 0.520s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.544s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-94802822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d7ae55-4b88-4a2a-b395-4e8373823ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:31Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Creating volume f4d7ae55-4b88-4a2a-b395-4e8373823ae2 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:35 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dc586b-1077-4674-ab81-c58235a6893d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-333160046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1a5771-90de-45cf-a651-95e16563127e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:35Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a60878-cedc-4344-909a-10f1347caa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 1073741824
Sep 23 00:27:35 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a60878-cedc-4344-909a-10f1347caa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9236427d-39ee-4c8d-94a2-e54e40174a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9236427d-39ee-4c8d-94a2-e54e40174a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1a5771-90de-45cf-a651-95e16563127e', 'volume_name': 'volume-de1a5771-90de-45cf-a651-95e16563127e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4aedf2f-748e-4d62-8dbb-73ddf139e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4aedf2f-748e-4d62-8dbb-73ddf139e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0dcd4f-a186-46ce-98e4-07ea8e6e5a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume de1a5771-90de-45cf-a651-95e16563127e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1a5771-90de-45cf-a651-95e16563127e', 'volume_size': 1}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb91657-3534-47b5-9203-10137899c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccaeab0-f84e-4992-a955-9a6e334a7387', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a76dc1d-535e-435f-8b4d-0be65b9dcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 (9ccaeab0-f84e-4992-a955-9a6e334a7387): created successfully
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a76dc1d-535e-435f-8b4d-0be65b9dcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (f937bf9a-5e39-4d66-a99e-f09cac5553c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-15635fc4-51cb-44a2-8585-2acd507740f0 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created volume successfully.
Sep 23 00:27:35 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 1073741824" returned: 0 in 0.838s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:36 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2
Sep 23 00:27:36 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:36 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2" returned: 0 in 0.462s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.810s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235278685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3a625d-b56d-4344-abac-92bda2b88dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Creating volume fd3a625d-b56d-4344-abac-92bda2b88dcc {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:36 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:36 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc 1073741824
Sep 23 00:27:36 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8430c416-c9df-4117-80b8-281c8820fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ed9c22-2548-454b-80a0-9deb37fee9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 (f4d7ae55-4b88-4a2a-b395-4e8373823ae2): created successfully
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ed9c22-2548-454b-80a0-9deb37fee9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (2c276ff4-da40-4e93-ae84-25d358224327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-de632986-34e0-4cfe-a00c-67094377435e tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created volume successfully.
Sep 23 00:27:37 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc 1073741824" returned: 0 in 0.829s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:37 devstack sudo[101511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc
Sep 23 00:27:37 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:37 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc" returned: 0 in 0.425s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.847s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1933392951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f24e4b6-0621-4d3b-912f-a364ae67d3e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f78bafebd354457a048414cb8aa6f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:35Z,use_quota=True,user_id='cab8cfc1afe94199a36081e1dac45d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Creating volume 1f24e4b6-0621-4d3b-912f-a364ae67d3e2 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:37 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e1bc0a-671d-42f2-a97c-88b75a2a401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3a625d-b56d-4344-abac-92bda2b88dcc', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701bca14-4a01-4708-a635-043294fc0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:37 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 1073741824
Sep 23 00:27:37 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume volume-fd3a625d-b56d-4344-abac-92bda2b88dcc (fd3a625d-b56d-4344-abac-92bda2b88dcc): created successfully
Sep 23 00:27:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701bca14-4a01-4708-a635-043294fc0de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (ecd62f1f-0b03-41ef-8b9e-e6176e5e2c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2a4d3c07-70df-4d99-999b-68cfc4bac5c6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created volume successfully.
Sep 23 00:27:38 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 1073741824" returned: 0 in 0.778s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:38 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2
Sep 23 00:27:38 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:39 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2" returned: 0 in 0.491s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.040s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-333160046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1a5771-90de-45cf-a651-95e16563127e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb2fba2761d4737a3e5972ac80c5129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:35Z,use_quota=True,user_id='84296152d4be4ca4b77786a470588050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Creating volume de1a5771-90de-45cf-a651-95e16563127e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:39 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:39 devstack sudo[101525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e 1073741824
Sep 23 00:27:39 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321488e1-d21f-43ef-b85b-053a4623b641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea5f989-a4b9-4460-bc79-9c96dfa47d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Volume volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 (1f24e4b6-0621-4d3b-912f-a364ae67d3e2): created successfully
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea5f989-a4b9-4460-bc79-9c96dfa47d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Flow 'volume_create_manager' (16e57235-6d96-4837-b9f2-6611cdaa85f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1ad75b45-0fb0-4954-891b-74432c996c37 tempest-VolumesListTestJSON-1732215027 None] Created volume successfully.
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:40 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:40 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:40 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e 1073741824" returned: 0 in 0.859s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:40 devstack sudo[101541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e
Sep 23 00:27:40 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:40 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.909s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:27:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:27:41 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e" returned: 0 in 0.776s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0dcd4f-a186-46ce-98e4-07ea8e6e5a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1a5771-90de-45cf-a651-95e16563127e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495d94ba-36b5-486a-98e3-bdee06603626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:41 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Volume volume-de1a5771-90de-45cf-a651-95e16563127e (de1a5771-90de-45cf-a651-95e16563127e): created successfully
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495d94ba-36b5-486a-98e3-bdee06603626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Flow 'volume_create_manager' (61a2622f-106f-41fd-ae85-0255578e3162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-27b33388-bbff-44b1-97b9-ccd65a92c21a tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created volume successfully.
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Flow 'volume_create_manager' (332d501b-4d7c-415e-be54-f6938ac8eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48efdc98-4a4e-4dd4-b4d5-7b1e545f4c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48efdc98-4a4e-4dd4-b4d5-7b1e545f4c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1798486357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441f30f9-3ad3-405a-afad-2c0acb1abac6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f78bafebd354457a048414cb8aa6f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:41Z,use_quota=True,user_id='cab8cfc1afe94199a36081e1dac45d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1908f47-d55c-474d-b6b6-1e88af10688c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1908f47-d55c-474d-b6b6-1e88af10688c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f4f4f0-9513-432b-8d8b-a07533f59800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f4f4f0-9513-432b-8d8b-a07533f59800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441f30f9-3ad3-405a-afad-2c0acb1abac6', 'volume_name': 'volume-441f30f9-3ad3-405a-afad-2c0acb1abac6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e099762d-8f87-41ef-8cf7-4fda33f66914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e099762d-8f87-41ef-8cf7-4fda33f66914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d5ca0-7425-4f63-bc26-2523a7fc7ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:41 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Volume 441f30f9-3ad3-405a-afad-2c0acb1abac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441f30f9-3ad3-405a-afad-2c0acb1abac6', 'volume_size': 1}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1798486357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441f30f9-3ad3-405a-afad-2c0acb1abac6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f78bafebd354457a048414cb8aa6f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:41Z,use_quota=True,user_id='cab8cfc1afe94199a36081e1dac45d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Creating volume 441f30f9-3ad3-405a-afad-2c0acb1abac6 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:41 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:41 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 1073741824
Sep 23 00:27:41 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-de1a5771-90de-45cf-a651-95e16563127e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-de1a5771-90de-45cf-a651-95e16563127e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-quobyte-de1a5771-90de-45cf-a651-95e16563127e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-de1a5771-90de-45cf-a651-95e16563127e" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[48776cd2-5b21-49e6-91f0-4aead568fdf9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:42 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e
Sep 23 00:27:42 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:42 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 1073741824" returned: 0 in 0.850s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:42 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6
Sep 23 00:27:42 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:42 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e" returned: 0 in 0.579s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:42 devstack sudo[101566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e
Sep 23 00:27:42 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:42 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6" returned: 0 in 0.397s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d5ca0-7425-4f63-bc26-2523a7fc7ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441f30f9-3ad3-405a-afad-2c0acb1abac6', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6c90f1-d922-40a5-afb9-8294151453d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Volume volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 (441f30f9-3ad3-405a-afad-2c0acb1abac6): created successfully
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6c90f1-d922-40a5-afb9-8294151453d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Flow 'volume_create_manager' (332d501b-4d7c-415e-be54-f6938ac8eda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-58047b16-381b-43c8-a24b-2ce4677a62ab tempest-VolumesListTestJSON-1732215027 None] Created volume successfully.
Sep 23 00:27:43 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-de1a5771-90de-45cf-a651-95e16563127e" returned: 0 in 0.382s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-de1a5771-90de-45cf-a651-95e16563127e" released by "delete_volume" :: held 1.040s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created reservations ['3b98ef00-3093-4f9d-9c8e-31feed6859d8', '464e76e4-bee0-4c2f-a10e-b0f8539b3891', 'c23d45cc-ba88-44d3-8188-bb847587f472', 'd4331029-16e0-488e-ab8a-c3c235b6a1be', 'd07876fb-ddb6-4aa6-a81d-216bd27ba115'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:43 devstack sudo[101570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:43 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:43 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.434s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Deleted volume successfully.
Sep 23 00:27:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3c5d86d9-b9da-4bc0-86e8-06e52accdde6 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-de1a5771-90de-45cf-a651-95e16563127e-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-fd3a625d-b56d-4344-abac-92bda2b88dcc-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-fd3a625d-b56d-4344-abac-92bda2b88dcc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-quobyte-fd3a625d-b56d-4344-abac-92bda2b88dcc" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-fd3a625d-b56d-4344-abac-92bda2b88dcc" acquired by "delete_volume" :: waited 0.040s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fddc8-c9c2-4baa-9e57-45b4ec95805b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:44 devstack sudo[101573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc
Sep 23 00:27:44 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:45 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:45 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc
Sep 23 00:27:45 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:45 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd3a625d-b56d-4344-abac-92bda2b88dcc" returned: 0 in 0.416s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-fd3a625d-b56d-4344-abac-92bda2b88dcc" released by "delete_volume" :: held 1.135s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created reservations ['c9bbb278-9212-414c-9c80-a81e343492f1', '4bdee2d3-5c3b-4720-b997-c588bb66687d', 'c8ffb8d6-fc2b-4d78-b8dc-81721ca67835', 'fad92b41-03c1-4bba-b883-01181c1c6620', 'ffad1a9c-3a16-4b43-b2ed-fa9deffb1049'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:45 devstack sudo[101581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:45 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:46 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.454s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Deleted volume successfully.
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-51809e38-6927-47a6-a310-15a8c1d65ae3 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-fd3a625d-b56d-4344-abac-92bda2b88dcc-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "cinder-441f30f9-3ad3-405a-afad-2c0acb1abac6-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-441f30f9-3ad3-405a-afad-2c0acb1abac6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-f4d7ae55-4b88-4a2a-b395-4e8373823ae2-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-f4d7ae55-4b88-4a2a-b395-4e8373823ae2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "cinder-quobyte-441f30f9-3ad3-405a-afad-2c0acb1abac6" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-quobyte-441f30f9-3ad3-405a-afad-2c0acb1abac6" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-quobyte-f4d7ae55-4b88-4a2a-b395-4e8373823ae2" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-f4d7ae55-4b88-4a2a-b395-4e8373823ae2" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db347d8-6ca2-44a9-975b-1c032d32280d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c46954e-5ca0-4472-a57f-93f5ce3ade71]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6
Sep 23 00:27:47 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack sudo[101585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2
Sep 23 00:27:47 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2" returned: 0 in 0.489s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack sudo[101594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2
Sep 23 00:27:47 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6" returned: 0 in 0.566s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6
Sep 23 00:27:47 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4d7ae55-4b88-4a2a-b395-4e8373823ae2" returned: 0 in 0.309s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-f4d7ae55-4b88-4a2a-b395-4e8373823ae2" released by "delete_volume" :: held 0.885s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created reservations ['fd152639-290d-4dd4-97b5-e0fe11d26be5', 'ec61d810-5b8f-4f75-9f9e-1c4a667a16a9', '1348b8cd-028e-4fb2-8d0b-65149d198a7c', '78e54240-26e7-4d12-8eda-060e2729bb3b', '8238197e-e197-403a-b2c9-774d9261fab6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:48 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-441f30f9-3ad3-405a-afad-2c0acb1abac6" returned: 0 in 0.507s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-quobyte-441f30f9-3ad3-405a-afad-2c0acb1abac6" released by "delete_volume" :: held 1.177s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:48 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:48 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Created reservations ['e00f865e-35fa-49ec-b51a-8f1a123c305e', '97e64ace-36bf-44a1-80c0-bc512e0d81e2', '7c5d932c-7431-4fa2-b1dc-a2392ec344e9', '4d301d34-da5a-41e3-9310-c5da0e6dce5a', '993b9c5f-1848-40f2-b23c-d46ab5920da4'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:48 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:48 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:48 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.423s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Deleted volume successfully.
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-13cdc63c-b14a-4410-a948-72146970d302 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-f4d7ae55-4b88-4a2a-b395-4e8373823ae2-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:48 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.408s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Deleted volume successfully.
Sep 23 00:27:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e0f6f9b2-de07-41dc-8abd-418a61f557c4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-441f30f9-3ad3-405a-afad-2c0acb1abac6-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "cinder-1f24e4b6-0621-4d3b-912f-a364ae67d3e2-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-1f24e4b6-0621-4d3b-912f-a364ae67d3e2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-9ccaeab0-f84e-4992-a955-9a6e334a7387-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-9ccaeab0-f84e-4992-a955-9a6e334a7387-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "cinder-quobyte-1f24e4b6-0621-4d3b-912f-a364ae67d3e2" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-quobyte-1f24e4b6-0621-4d3b-912f-a364ae67d3e2" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-quobyte-9ccaeab0-f84e-4992-a955-9a6e334a7387" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-9ccaeab0-f84e-4992-a955-9a6e334a7387" acquired by "delete_volume" :: waited 0.015s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa7c30-fd90-47d5-9e04-09acf602a32a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d6ca8-c078-43c5-ae36-528f4677b77e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:49 devstack sudo[101629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2
Sep 23 00:27:49 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:49 devstack sudo[101630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387
Sep 23 00:27:49 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:49 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2" returned: 0 in 0.411s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:49 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387" returned: 0 in 0.410s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:49 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2
Sep 23 00:27:49 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:49 devstack sudo[101640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387
Sep 23 00:27:49 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:50 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f24e4b6-0621-4d3b-912f-a364ae67d3e2" returned: 0 in 0.285s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-quobyte-1f24e4b6-0621-4d3b-912f-a364ae67d3e2" released by "delete_volume" :: held 0.771s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Created reservations ['b3d84047-4f29-44f1-8dd5-4e749a9396c2', '93f41570-da24-47dd-98b7-cf145ad57e87', '648fad93-2d3f-4519-99be-c84a08c32def', '7eb67e8c-69c1-454c-b154-97306081930f', '55dcd0f9-59cc-403a-9a6d-5e595e57b6c8'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:50 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9ccaeab0-f84e-4992-a955-9a6e334a7387" returned: 0 in 0.371s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-9ccaeab0-f84e-4992-a955-9a6e334a7387" released by "delete_volume" :: held 0.834s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:50 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created reservations ['6e9f1357-f31f-418d-9113-1e1ece360c04', '60be8a68-0bbb-40fc-93c2-f4f36350fffc', '0f6fafa7-6e03-4f20-ba63-2c81e7751685', '06fab38a-b204-435f-a2d3-8d12f93e2e88', 'eda03d35-84e3-492f-a3d1-efa8637a3623'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:50 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "cinder-fd897a44-f98f-4a8f-94d3-6936257bce8c-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:50 devstack sudo[101654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:50 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-fd897a44-f98f-4a8f-94d3-6936257bce8c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "cinder-quobyte-fd897a44-f98f-4a8f-94d3-6936257bce8c" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-quobyte-fd897a44-f98f-4a8f-94d3-6936257bce8c" acquired by "delete_volume" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:50 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.472s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Deleted volume successfully.
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e8113a-ede9-4c23-a9c6-bbc769bdcbfe]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dac49721-d444-4e12-a3ae-1becae0f27d4 tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-1f24e4b6-0621-4d3b-912f-a364ae67d3e2-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:50 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.381s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Deleted volume successfully.
Sep 23 00:27:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-42dcff1c-79af-4193-b5f2-58ce3edc59df tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-9ccaeab0-f84e-4992-a955-9a6e334a7387-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:50 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c
Sep 23 00:27:50 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:51 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c" returned: 0 in 0.405s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:51 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c
Sep 23 00:27:51 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:51 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fd897a44-f98f-4a8f-94d3-6936257bce8c" returned: 0 in 0.264s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-quobyte-fd897a44-f98f-4a8f-94d3-6936257bce8c" released by "delete_volume" :: held 0.745s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-542b0698-5cbd-46fe-85fb-71de8b5bb1a6-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-542b0698-5cbd-46fe-85fb-71de8b5bb1a6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Created reservations ['fa6a75d4-2ddf-4b09-a27d-eafe842f8a30', 'c94e5ab0-4f45-4a8d-98c4-ed092a86128f', '434de7ea-23d6-469a-86fe-dcdb6a1aff0c', '3025022d-8e49-47fb-bbac-139e6c85a6fa', '95082494-7b72-4b74-8df6-9cda194fb539'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-quobyte-542b0698-5cbd-46fe-85fb-71de8b5bb1a6" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-542b0698-5cbd-46fe-85fb-71de8b5bb1a6" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1b3440-cab3-42c9-9bf5-d59d38ac4fa2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:51 devstack sudo[101668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:51 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:51 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6
Sep 23 00:27:51 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:52 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.350s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:52 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Deleted volume successfully.
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-af54a4db-35d1-4fbc-95ed-5b5a5a1dc5ab tempest-VolumesListTestJSON-1732215027 None] Lock "cinder-fd897a44-f98f-4a8f-94d3-6936257bce8c-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:52 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6" returned: 0 in 0.474s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:52 devstack sudo[101675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6
Sep 23 00:27:52 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:52 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-542b0698-5cbd-46fe-85fb-71de8b5bb1a6" returned: 0 in 0.316s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-542b0698-5cbd-46fe-85fb-71de8b5bb1a6" released by "delete_volume" :: held 0.847s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created reservations ['b6c84009-9b0f-4d40-8137-246914d01120', '6575ca00-476f-4a7f-a528-65254ffb5cb9', 'ad38a720-9696-4e73-a4cb-da04eacbaa53', 'a2f9084f-1476-4029-af7d-b312ea7609bf', '0f3a2485-b154-4db1-9444-4d39f9cc8f43'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:52 devstack sudo[101678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:52 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-04fb3f21-5bcf-414c-ac81-7bf79844b266-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-04fb3f21-5bcf-414c-ac81-7bf79844b266-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "cinder-quobyte-04fb3f21-5bcf-414c-ac81-7bf79844b266" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-04fb3f21-5bcf-414c-ac81-7bf79844b266" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e447b3-1f3f-4a87-808e-d438278b0db4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:53 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:53 devstack sudo[101680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.365s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:53 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Deleted volume successfully.
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba7fa25e-c64a-486d-8981-6d75d00d5246 tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-542b0698-5cbd-46fe-85fb-71de8b5bb1a6-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:53 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266" returned: 0 in 0.523s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:53 devstack sudo[101686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266
Sep 23 00:27:53 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:53 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-04fb3f21-5bcf-414c-ac81-7bf79844b266" returned: 0 in 0.362s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-quobyte-04fb3f21-5bcf-414c-ac81-7bf79844b266" released by "delete_volume" :: held 0.940s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:53 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Created reservations ['1affa0ca-0b5e-4582-a152-859740886177', 'ba51c1e5-d07c-4104-b1a7-8e4cb27fff0f', '75f528cb-0c4d-415b-897a-d9fc849a21d0', '84a02d21-86ce-49ae-ba04-1e1a9d388e6f', '9ae25d77-c194-4c9e-a24d-35d25e033561'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:54 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:27:54 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:54 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.283s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:54 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Deleted volume successfully.
Sep 23 00:27:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bcef5d9a-7fe4-4cd3-9177-723e2346ed4c tempest-CreateVolumesFromSourceVolumeTest-470910636 None] Lock "cinder-04fb3f21-5bcf-414c-ac81-7bf79844b266-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Flow 'volume_create_manager' (ae50980c-e44c-4339-8a0f-06bec4de7cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb516617-bd7e-4367-b687-78c71c5c71f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb516617-bd7e-4367-b687-78c71c5c71f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f854212c-8a0f-4f01-be0c-9f2df891db42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7abfb13e67b4e39a3375de9bc93a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:59Z,use_quota=True,user_id='d994790f5c4344a7b42428c6822d836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e31c04-296c-457b-92e8-4f7ff7c8fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e31c04-296c-457b-92e8-4f7ff7c8fb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9d350d-55a5-4ee8-8acb-da8884547451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9d350d-55a5-4ee8-8acb-da8884547451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f854212c-8a0f-4f01-be0c-9f2df891db42', 'volume_name': 'volume-f854212c-8a0f-4f01-be0c-9f2df891db42', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a69350-ca5a-483f-9dea-22470437eacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a69350-ca5a-483f-9dea-22470437eacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44106ca7-2939-4a45-84d6-ae113c138ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Volume f854212c-8a0f-4f01-be0c-9f2df891db42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f854212c-8a0f-4f01-be0c-9f2df891db42', 'volume_size': 1}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f854212c-8a0f-4f01-be0c-9f2df891db42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7abfb13e67b4e39a3375de9bc93a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:59Z,use_quota=True,user_id='d994790f5c4344a7b42428c6822d836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Creating volume f854212c-8a0f-4f01-be0c-9f2df891db42 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:59 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:27:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:59 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42 1073741824
Sep 23 00:27:59 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:00 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42 1073741824" returned: 0 in 0.703s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:00 devstack sudo[101704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42
Sep 23 00:28:00 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:00 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42" returned: 0 in 0.305s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44106ca7-2939-4a45-84d6-ae113c138ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f854212c-8a0f-4f01-be0c-9f2df891db42', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa53322-c5cc-4d3e-a95b-f1472c4897f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Volume volume-f854212c-8a0f-4f01-be0c-9f2df891db42 (f854212c-8a0f-4f01-be0c-9f2df891db42): created successfully
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa53322-c5cc-4d3e-a95b-f1472c4897f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Flow 'volume_create_manager' (ae50980c-e44c-4339-8a0f-06bec4de7cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e431c112-c321-4fb7-a177-10b218525057 tempest-CinderUnicodeTest-1765596969 None] Created volume successfully.
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Flow 'volume_create_manager' (7203a2c6-4cc3-4cba-9421-7cd7b327602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f764b479-334c-4405-9752-edc2a66dfbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f764b479-334c-4405-9752-edc2a66dfbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1012152043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83011bdc-d876-4472-98dd-876cd8be40a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b080d7b2cc42dfb7ed4efa539d71d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='46ca610b964c480390c2c454f88043c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d07c73-5c83-4ed1-8461-58700a223868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d07c73-5c83-4ed1-8461-58700a223868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebab877-b374-4980-94c2-604b154faac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebab877-b374-4980-94c2-604b154faac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83011bdc-d876-4472-98dd-876cd8be40a3', 'volume_name': 'volume-83011bdc-d876-4472-98dd-876cd8be40a3', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9939d98e-98e0-47db-ad7d-04e9bff1d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9939d98e-98e0-47db-ad7d-04e9bff1d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf4c725-c51a-4600-afba-b5b3ec7df994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Volume 83011bdc-d876-4472-98dd-876cd8be40a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83011bdc-d876-4472-98dd-876cd8be40a3', 'volume_size': 1}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1012152043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83011bdc-d876-4472-98dd-876cd8be40a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b080d7b2cc42dfb7ed4efa539d71d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='46ca610b964c480390c2c454f88043c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Creating volume 83011bdc-d876-4472-98dd-876cd8be40a3 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:02 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:02 devstack sudo[101708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3 1073741824
Sep 23 00:28:02 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Flow 'volume_create_manager' (b0c33b35-1233-4514-8dd1-5b2234c126c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eea773c-bddc-43c9-9016-658b34098394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eea773c-bddc-43c9-9016-658b34098394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1960479558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c3fd5e-cf29-45d2-ac30-b4b206763944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7abfb13e67b4e39a3375de9bc93a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='d994790f5c4344a7b42428c6822d836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10736ba6-3ef1-46a8-9f11-9862a1d31b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10736ba6-3ef1-46a8-9f11-9862a1d31b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82eff8b-6ab2-49e3-86ce-d189a94a6a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82eff8b-6ab2-49e3-86ce-d189a94a6a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c3fd5e-cf29-45d2-ac30-b4b206763944', 'volume_name': 'volume-56c3fd5e-cf29-45d2-ac30-b4b206763944', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e722c882-9ad7-46d8-b6de-df75a219b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e722c882-9ad7-46d8-b6de-df75a219b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea7f66d-cc26-434c-96b3-420746b7cbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Volume 56c3fd5e-cf29-45d2-ac30-b4b206763944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c3fd5e-cf29-45d2-ac30-b4b206763944', 'volume_size': 1}
Sep 23 00:28:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:03 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3 1073741824" returned: 0 in 0.774s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:03 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3
Sep 23 00:28:03 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:03 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1960479558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c3fd5e-cf29-45d2-ac30-b4b206763944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7abfb13e67b4e39a3375de9bc93a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='d994790f5c4344a7b42428c6822d836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Creating volume 56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:03 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:03 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 1073741824
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf4c725-c51a-4600-afba-b5b3ec7df994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83011bdc-d876-4472-98dd-876cd8be40a3', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:03 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cffd92b-51f4-47ed-ba30-321255f99246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:03 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Volume volume-83011bdc-d876-4472-98dd-876cd8be40a3 (83011bdc-d876-4472-98dd-876cd8be40a3): created successfully
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cffd92b-51f4-47ed-ba30-321255f99246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Flow 'volume_create_manager' (7203a2c6-4cc3-4cba-9421-7cd7b327602d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-74a8515e-41d8-4ec6-b772-b85f8a0a5fa2 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Created volume successfully.
Sep 23 00:28:04 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 1073741824" returned: 0 in 0.854s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:04 devstack sudo[101728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944
Sep 23 00:28:04 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:05 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944" returned: 0 in 0.448s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea7f66d-cc26-434c-96b3-420746b7cbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c3fd5e-cf29-45d2-ac30-b4b206763944', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dee9b8-db47-4d6a-af60-b1fb8fbc0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Volume volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 (56c3fd5e-cf29-45d2-ac30-b4b206763944): created successfully
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dee9b8-db47-4d6a-af60-b1fb8fbc0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Flow 'volume_create_manager' (b0c33b35-1233-4514-8dd1-5b2234c126c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b75a9703-0b7d-4f8d-8a54-b19aa4f10a44 tempest-CinderUnicodeTest-1765596969 None] Created volume successfully.
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-b5c6e7a7-339f-49be-8c82-7223aba63ff9 req-12f56da8-27be-4e3b-ace9-83901db5938c tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-b5c6e7a7-339f-49be-8c82-7223aba63ff9 req-12f56da8-27be-4e3b-ace9-83901db5938c tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-b5c6e7a7-339f-49be-8c82-7223aba63ff9 req-12f56da8-27be-4e3b-ace9-83901db5938c tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-b5c6e7a7-339f-49be-8c82-7223aba63ff9 req-12f56da8-27be-4e3b-ace9-83901db5938c tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-83011bdc-d876-4472-98dd-876cd8be40a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc2aefa6-0753-4ba3-88a7-720d7e42e25b', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:28:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-b5c6e7a7-339f-49be-8c82-7223aba63ff9 req-12f56da8-27be-4e3b-ace9-83901db5938c tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] attachment_update completed successfully.
Sep 23 00:28:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Creating offline snapshot d9035953-2ad2-41cb-97e2-40600aab14be of volume 56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:28:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd6f3cb-ebcc-4320-bb01-f4b479d8373d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:06 devstack sudo[101741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944
Sep 23 00:28:06 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:07 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944" returned: 0 in 0.563s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:07 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be 1G
Sep 23 00:28:07 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:07 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be 1G" returned: 0 in 0.606s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:07 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be
Sep 23 00:28:07 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:08 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be" returned: 0 in 0.606s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:08 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be is being set with open permissions: ugo+rw
Sep 23 00:28:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:08 devstack sudo[101759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be
Sep 23 00:28:08 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:08 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be" returned: 0 in 0.428s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:08 devstack sudo[101762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info
Sep 23 00:28:08 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:09 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:09 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info is being set with open permissions: ugo+rw
Sep 23 00:28:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:09 devstack sudo[101765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info
Sep 23 00:28:09 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:09 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.info" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.194s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e3fbd3ed-33e1-42fc-8030-9c52ba232640 tempest-CinderUnicodeTest-1765596969 None] Create snapshot completed successfully
Sep 23 00:28:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-1baf4ae6-d636-4409-9c20-4f65223b2e4c req-bc9ae8c9-e1b9-453e-913f-2fc94a2101a5 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Terminate volume connection completed successfully.
Sep 23 00:28:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-1baf4ae6-d636-4409-9c20-4f65223b2e4c req-bc9ae8c9-e1b9-453e-913f-2fc94a2101a5 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Deleting attachment dc2aefa6-0753-4ba3-88a7-720d7e42e25b. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (2f7a74a9-a424-4e5d-841b-576019e73305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a521e6-75c9-495a-a459-382e9628048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a521e6-75c9-495a-a459-382e9628048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-199055048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c1df94-c87a-4c11-8520-bc70fa9bb6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:11Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214deea8-074e-4801-ab29-9da4ae981a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214deea8-074e-4801-ab29-9da4ae981a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1cbcfb-e6e8-46d1-b856-47365e39d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1cbcfb-e6e8-46d1-b856-47365e39d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c1df94-c87a-4c11-8520-bc70fa9bb6bb', 'volume_name': 'volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf692882-e262-4c42-bc68-a5c6a0871f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf692882-e262-4c42-bc68-a5c6a0871f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e276c435-70b4-4110-9aab-617a8baa6fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:10 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Volume b6c1df94-c87a-4c11-8520-bc70fa9bb6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb', 'volume_size': 1}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-199055048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c1df94-c87a-4c11-8520-bc70fa9bb6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:11Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Creating volume b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:10 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-d9035953-2ad2-41cb-97e2-40600aab14be-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:10 devstack sudo[101774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb 1073741824
Sep 23 00:28:10 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-d9035953-2ad2-41cb-97e2-40600aab14be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-quobyte-56c3fd5e-cf29-45d2-ac30-b4b206763944" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-56c3fd5e-cf29-45d2-ac30-b4b206763944" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-quobyte-d9035953-2ad2-41cb-97e2-40600aab14be" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-d9035953-2ad2-41cb-97e2-40600aab14be" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Deleting offline snapshot d9035953-2ad2-41cb-97e2-40600aab14be of volume 56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:28:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] snapshot_file for this snap is: volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562932e-b51a-401e-b4cc-fc66e334aac6]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Acquiring lock "cinder-83011bdc-d876-4472-98dd-876cd8be40a3-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "cinder-83011bdc-d876-4472-98dd-876cd8be40a3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Acquiring lock "cinder-quobyte-83011bdc-d876-4472-98dd-876cd8be40a3" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "cinder-quobyte-83011bdc-d876-4472-98dd-876cd8be40a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:11 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be
Sep 23 00:28:11 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46f82ed-3954-4c94-aeee-822b22d46122]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:11 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3
Sep 23 00:28:11 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:11 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb 1073741824" returned: 0 in 0.632s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:11 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be" returned: 0 in 0.564s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c3fd5e-cf29-45d2-ac30-b4b206763944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:28:11 devstack sudo[101790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb
Sep 23 00:28:11 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a813c-fdc9-4747-86b2-abc5d1b7ef16]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:11 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3" returned: 0 in 0.540s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:11 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944
Sep 23 00:28:11 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:11 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3
Sep 23 00:28:11 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:12 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" returned: 0 in 0.443s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e276c435-70b4-4110-9aab-617a8baa6fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab96de2-16ed-44ed-89c0-142982655c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Volume volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb (b6c1df94-c87a-4c11-8520-bc70fa9bb6bb): created successfully
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab96de2-16ed-44ed-89c0-142982655c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (2f7a74a9-a424-4e5d-841b-576019e73305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a0977b03-75bf-4733-a1ee-8d34514e7769 tempest-VolumesSnapshotTestJSON-674914980 None] Created volume successfully.
Sep 23 00:28:12 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944" returned: 0 in 0.562s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:12 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be
Sep 23 00:28:12 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:12 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83011bdc-d876-4472-98dd-876cd8be40a3" returned: 0 in 0.494s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "cinder-quobyte-83011bdc-d876-4472-98dd-876cd8be40a3" released by "delete_volume" :: held 1.094s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Created reservations ['d82cb874-9d37-49ee-8843-6cda1d353923', '1963ef6b-f767-49d2-9335-e9dd30d07cbe', 'c33519b3-1e30-4e0d-b8d8-85a4f3b711f9', '911eed46-effe-483d-8644-0818b5fd6baf', 'dd465213-753a-47ce-85d5-7ea7dce99163'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:12 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:12 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:12 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be" returned: 0 in 0.543s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:12 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be
Sep 23 00:28:12 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:12 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Deleted volume successfully.
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff634f08-de77-4337-8090-602ae43e4c50 tempest-TestServerVolumeAttachScenarioOldVersion-216756475 None] Lock "cinder-83011bdc-d876-4472-98dd-876cd8be40a3-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:13 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944.d9035953-2ad2-41cb-97e2-40600aab14be" returned: 0 in 0.477s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-d9035953-2ad2-41cb-97e2-40600aab14be" released by "_delete_snapshot" :: held 2.365s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-56c3fd5e-cf29-45d2-ac30-b4b206763944" released by "delete_snapshot" :: held 2.403s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Created reservations ['41869c1e-098b-40ee-96ef-b74af3dba31a', '694ea0a2-5350-4cba-ba38-f5b50228b3b6', 'aacaf0e3-6ffd-4011-b430-ca3f2517047f', '111c5baa-60b2-4491-ad77-0dc45c8d9e56', '2088a0f6-4d4f-484d-b930-b53f45867da9'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Creating offline snapshot 1776be68-51b7-46f1-a8d7-db202649ee26 of volume b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c263f584-7b3a-4d86-9ff3-ef0d67cca1e6]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Delete snapshot completed successfully.
Sep 23 00:28:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2a2d8f0-26fa-4459-b977-4f4c5c36bcbc tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-d9035953-2ad2-41cb-97e2-40600aab14be-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:13 devstack sudo[101823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb
Sep 23 00:28:13 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-56c3fd5e-cf29-45d2-ac30-b4b206763944-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-56c3fd5e-cf29-45d2-ac30-b4b206763944-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:14 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" returned: 0 in 0.738s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:14 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 1G
Sep 23 00:28:14 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-quobyte-56c3fd5e-cf29-45d2-ac30-b4b206763944" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-56c3fd5e-cf29-45d2-ac30-b4b206763944" acquired by "delete_volume" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99959ff-a177-4edf-9912-3fdf7c8e5fc0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:14 devstack sudo[101850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944
Sep 23 00:28:14 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 1G" returned: 0 in 0.951s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:15 devstack sudo[101861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26
Sep 23 00:28:15 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944" returned: 0 in 0.867s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:15 devstack sudo[101864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944
Sep 23 00:28:15 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-a5f92caa-a116-4542-94d2-c46d1b08818e req-efe8c7bb-dd4a-466c-8a12-17f4d7c784aa tempest-TestMinimumBasicScenario-1605113421 None] Terminate volume connection completed successfully.
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-a5f92caa-a116-4542-94d2-c46d1b08818e req-efe8c7bb-dd4a-466c-8a12-17f4d7c784aa tempest-TestMinimumBasicScenario-1605113421 None] Deleting attachment da6fd918-19b1-4c5a-a762-b886a948a793. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:28:15 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26" returned: 0 in 0.663s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:15 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 is being set with open permissions: ugo+rw
Sep 23 00:28:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:16 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26
Sep 23 00:28:16 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-56c3fd5e-cf29-45d2-ac30-b4b206763944" returned: 0 in 0.526s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-56c3fd5e-cf29-45d2-ac30-b4b206763944" released by "delete_volume" :: held 1.551s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Created reservations ['1ea1c400-8d19-4bb6-b7cc-c8adc5724ea2', '1de42d3b-1d7b-4256-8f7d-926f62903818', '5cbbe785-fd42-48ae-8d03-d85a39abaf7e', '0e2911eb-ba72-488b-ac54-126ec9228c9b', 'cc66426f-fa0c-4fc3-9cfe-b5a382f5ca2b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:16 devstack sudo[101875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:16 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:16 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26" returned: 0 in 0.546s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-f854212c-8a0f-4f01-be0c-9f2df891db42-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Acquiring lock "cinder-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-f854212c-8a0f-4f01-be0c-9f2df891db42-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Lock "cinder-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:16 devstack sudo[101879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info
Sep 23 00:28:16 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "cinder-quobyte-f854212c-8a0f-4f01-be0c-9f2df891db42" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Acquiring lock "cinder-quobyte-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-f854212c-8a0f-4f01-be0c-9f2df891db42" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:16 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.557s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Lock "cinder-quobyte-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b" acquired by "delete_volume" :: waited 0.059s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b5800c-4425-478c-b889-28d2db81d78b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Deleted volume successfully.
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1dcc8-a61b-4ada-9662-0bc830328807]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9cf6b497-bd52-45a5-89fe-95e7f20b9aa0 tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-56c3fd5e-cf29-45d2-ac30-b4b206763944-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:17 devstack sudo[101882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42
Sep 23 00:28:17 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b
Sep 23 00:28:17 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info" returned: 0 in 0.617s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:17 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info is being set with open permissions: ugo+rw
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info
Sep 23 00:28:17 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42" returned: 0 in 0.721s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b" returned: 0 in 0.713s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack sudo[101897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42
Sep 23 00:28:17 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.info" returned: 0 in 0.411s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:17 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b
Sep 23 00:28:17 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.243s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d00d7615-8fa3-4aff-9332-3b359b633c58 tempest-VolumesSnapshotTestJSON-674914980 None] Create snapshot completed successfully
Sep 23 00:28:18 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f854212c-8a0f-4f01-be0c-9f2df891db42" returned: 0 in 0.382s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:18 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-quobyte-f854212c-8a0f-4f01-be0c-9f2df891db42" released by "delete_volume" :: held 1.211s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b" returned: 0 in 0.397s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Lock "cinder-quobyte-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b" released by "delete_volume" :: held 1.186s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Created reservations ['1a6dcc5b-4c66-4de0-8117-41f8d6680b1b', '98e76c6a-79f5-43f4-af62-2b49014ba341', 'a620d88f-e816-436c-b143-e89b6e7fea17', 'e4375f41-b44c-4569-aa03-49919d9aaed0', '2efa4231-8d85-4671-a61a-fdc3d627bf27'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Created reservations ['097424c7-157e-4821-8607-daf3f6a9e44d', '298cb245-a86f-4b39-8aa9-5670487b28c9', '9a6aa1df-6f45-4bc6-adf5-96022598f358', '9f66c5ca-d018-427a-8657-0dfcadddb020', '469aed26-6b9c-4809-8d99-179dfee50f36'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:18 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:18 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:18 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:18 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:18 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.342s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Deleted volume successfully.
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f2bb313a-415a-4049-b06d-b09eb4670aca tempest-CinderUnicodeTest-1765596969 None] Lock "cinder-f854212c-8a0f-4f01-be0c-9f2df891db42-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:18 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.348s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Deleted volume successfully.
Sep 23 00:28:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa9adc8-15f4-49ff-805f-a24a73b21abe tempest-TestMinimumBasicScenario-1605113421 None] Lock "cinder-c1a4d4fe-501e-45dd-b8e6-593ae026cc3b-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-1776be68-51b7-46f1-a8d7-db202649ee26-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-1776be68-51b7-46f1-a8d7-db202649ee26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-1776be68-51b7-46f1-a8d7-db202649ee26" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-1776be68-51b7-46f1-a8d7-db202649ee26" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Deleting offline snapshot 1776be68-51b7-46f1-a8d7-db202649ee26 of volume b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] snapshot_file for this snap is: volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[867b651e-eddc-46bb-9f96-223b2957d489]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:19 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26
Sep 23 00:28:19 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:20 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26" returned: 0 in 0.829s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:28:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[73626bef-eb35-47e6-aa0f-3d4ac5e561f9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:20 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb
Sep 23 00:28:20 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:20 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" returned: 0 in 0.596s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:21 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26
Sep 23 00:28:21 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:21 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26" returned: 0 in 0.600s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:21 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26
Sep 23 00:28:21 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:22 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb.1776be68-51b7-46f1-a8d7-db202649ee26" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-1776be68-51b7-46f1-a8d7-db202649ee26" released by "_delete_snapshot" :: held 2.777s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" released by "delete_snapshot" :: held 2.824s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:22 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['a9b6a9d1-381d-405d-a2fc-8d8bfe10a52d', '00a1054d-efa7-4863-bbde-34260570383e', '40f86a3f-d9a8-4fba-9dc8-8ac6fa6e794e', '424cb2c6-d0d4-49b0-8117-ba4348456b93', 'e6009f58-a41c-4d18-a56b-ccfd428632f5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Delete snapshot completed successfully.
Sep 23 00:28:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b327b8ea-9e87-4bea-97f4-5ec665ecd342 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-1776be68-51b7-46f1-a8d7-db202649ee26-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (1a41b7ce-6c29-4f06-867b-54689acd8c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2783180-eb70-4e54-b92f-2ca0fcdf6e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2783180-eb70-4e54-b92f-2ca0fcdf6e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-266157411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4008ca0-e353-4408-a4a0-bf9939bdf6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:24Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6896b0-4bdd-473f-a94b-325e0a59022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6896b0-4bdd-473f-a94b-325e0a59022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6c4e10-4d73-4ea8-9d9a-f60a73e1fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6c4e10-4d73-4ea8-9d9a-f60a73e1fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4008ca0-e353-4408-a4a0-bf9939bdf6d4', 'volume_name': 'volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ebfed9-c3fe-452d-8719-9194f0f5f902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ebfed9-c3fe-452d-8719-9194f0f5f902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c98f18-dd10-4dc8-af05-20bf34f6f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:23 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Volume a4008ca0-e353-4408-a4a0-bf9939bdf6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4', 'volume_size': 1}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-266157411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4008ca0-e353-4408-a4a0-bf9939bdf6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:24Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Creating volume a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:23 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:28:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:23 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 1073741824
Sep 23 00:28:23 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:24 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 1073741824" returned: 0 in 0.716s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:24 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=150,cinder:UPDATE=173,cinder:INSERT=39,cinder:DELETE=16 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:28:24 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=177,cinder:SELECT=130,cinder:INSERT=51,cinder:DELETE=12 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:28:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:24 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4
Sep 23 00:28:24 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:25 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" returned: 0 in 0.416s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c98f18-dd10-4dc8-af05-20bf34f6f49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58fc909-12d2-4a7c-aa9d-c2b91f5e4a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:25 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Volume volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 (a4008ca0-e353-4408-a4a0-bf9939bdf6d4): created successfully
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58fc909-12d2-4a7c-aa9d-c2b91f5e4a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (1a41b7ce-6c29-4f06-867b-54689acd8c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4baab9a9-2e36-4b8a-b175-7a27723a8eec tempest-VolumesSnapshotTestJSON-674914980 None] Created volume successfully.
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Creating offline snapshot 14ee06fc-16b2-4034-a6e6-d99aa3f6b95e of volume a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a2749-21c0-45c6-bd6b-1ec1ade40066]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:26 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4
Sep 23 00:28:26 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:26 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" returned: 0 in 0.601s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:26 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e 1G
Sep 23 00:28:26 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:27 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e 1G" returned: 0 in 0.753s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:27 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e
Sep 23 00:28:27 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:28 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" returned: 0 in 0.703s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:28 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e is being set with open permissions: ugo+rw
Sep 23 00:28:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:28 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e
Sep 23 00:28:28 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:28 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:28 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info
Sep 23 00:28:28 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:28 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info" returned: 0 in 0.341s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:28 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info is being set with open permissions: ugo+rw
Sep 23 00:28:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:29 devstack sudo[102022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info
Sep 23 00:28:29 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:29 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.info" returned: 0 in 0.306s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1efbe613-485d-4c6a-b4a0-f762ad2811e6 tempest-VolumesSnapshotTestJSON-674914980 None] Create snapshot completed successfully
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (9696e549-1825-470c-9771-f6a158d0d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80654559-b950-41bb-bf03-f71ad316667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80654559-b950-41bb-bf03-f71ad316667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-164593933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a3d10d-e833-4360-9f04-a6de19a9ca3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=14ee06fc-16b2-4034-a6e6-d99aa3f6b95e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:31Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8461b739-595a-474b-bf65-cbab81389a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8461b739-595a-474b-bf65-cbab81389a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b077df-43a5-4f60-bc1f-d9fe9a8d284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b077df-43a5-4f60-bc1f-d9fe9a8d284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a8a3d10d-e833-4360-9f04-a6de19a9ca3a', 'volume_name': 'volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a', 'volume_size': 2, 'snapshot_id': '14ee06fc-16b2-4034-a6e6-d99aa3f6b95e'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3224d4f-7c92-49f4-8903-1bb3f09156ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3224d4f-7c92-49f4-8903-1bb3f09156ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fc1530-8eea-4611-8919-49b953f71490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Volume a8a3d10d-e833-4360-9f04-a6de19a9ca3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a', 'volume_size': 2, 'snapshot_id': '14ee06fc-16b2-4034-a6e6-d99aa3f6b95e'}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Creating volume a8a3d10d-e833-4360-9f04-a6de19a9ca3a from snapshot 14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] snapshot: 14ee06fc-16b2-4034-a6e6-d99aa3f6b95e, volume: a8a3d10d-e833-4360-9f04-a6de19a9ca3a,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de2154-c7ed-49cd-be7b-6aeecfbc1e04]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:31 devstack sudo[102027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e
Sep 23 00:28:31 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:32 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" returned: 0 in 0.467s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5609eb5-0ebd-4688-9cd8-5ca5c78a4b7c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:32 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4
Sep 23 00:28:32 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:32 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" returned: 0 in 0.506s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:28:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:32 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a
Sep 23 00:28:32 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:40 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:40 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:41 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 1.183s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:41 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:28:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:28:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:28:41 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1,cinder:SELECT=9 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:28:42 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" returned: 0 in 9.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:28:42 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Converted 1024.00 MB image at 108.88 MB/s
Sep 23 00:28:42 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a is being set with open permissions: ugo+rw
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:42 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a
Sep 23 00:28:42 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:42 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" returned: 0 in 0.272s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" released by "_copy_volume_from_snapshot" :: held 10.780s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" released by "_create_volume_from_snapshot" :: held 10.884s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.910s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fc1530-8eea-4611-8919-49b953f71490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a', 'volume_size': 2, 'snapshot_id': '14ee06fc-16b2-4034-a6e6-d99aa3f6b95e'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81890056-748c-46c5-b7ec-d5b9c981a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Volume volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a (a8a3d10d-e833-4360-9f04-a6de19a9ca3a): created successfully
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81890056-748c-46c5-b7ec-d5b9c981a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (9696e549-1825-470c-9771-f6a158d0d18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-427672a2-ea85-49bb-97c6-452773d3dc71 tempest-VolumesSnapshotTestJSON-674914980 None] Created volume successfully.
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-a8a3d10d-e833-4360-9f04-a6de19a9ca3a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-a8a3d10d-e833-4360-9f04-a6de19a9ca3a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" acquired by "delete_volume" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9397ac6-4fce-45d6-97d1-3340c386c015]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:43 devstack sudo[102062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a
Sep 23 00:28:43 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:43 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" returned: 0 in 0.710s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:43 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a
Sep 23 00:28:43 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:44 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a8a3d10d-e833-4360-9f04-a6de19a9ca3a" released by "delete_volume" :: held 1.190s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['9df92747-5312-4536-9be0-741b59e8f732', '9b8c11bb-685f-4589-aad3-6bbfbd5cd00d', '91dc132b-ad3a-41ef-b01f-c1d41f1fb2ce', '08e8cb00-3e96-4eb7-b1b0-ce0fe58d1d8c', '6f5db0a8-24f0-4621-ad8b-04adf3f96371'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:44 devstack sudo[102071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:44 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:44 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Deleted volume successfully.
Sep 23 00:28:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-feff4753-6951-44cc-8261-d02abdf14f7c tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-a8a3d10d-e833-4360-9f04-a6de19a9ca3a-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Deleting offline snapshot 14ee06fc-16b2-4034-a6e6-d99aa3f6b95e of volume a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] snapshot_file for this snap is: volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a00c49-56c6-4802-9e3c-85c97d8f5713]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:45 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e
Sep 23 00:28:45 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:46 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" returned: 0 in 0.535s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:28:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda80004-3fd7-4954-abd4-0ce34671f50d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:46 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4
Sep 23 00:28:46 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:47 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" returned: 0 in 0.897s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:47 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e
Sep 23 00:28:47 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:47 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" returned: 0 in 0.605s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:47 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e
Sep 23 00:28:47 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:48 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4.14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" returned: 0 in 0.349s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e" released by "_delete_snapshot" :: held 2.610s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" released by "delete_snapshot" :: held 2.654s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['442c9383-cc7e-4511-baa5-6e9d00fe013c', 'ab88feed-7cc1-4552-92f0-1b0b65269491', '4c3fe609-417b-491c-9b31-84ca790e3677', 'eb8bd101-8067-42b7-b14a-b8c7bb4c3853', '36f58bd8-ce47-4c80-8898-2033e39ac8ac'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Delete snapshot completed successfully.
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ba9b7ad-ec1f-4f80-ba79-936987b4633a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-14ee06fc-16b2-4034-a6e6-d99aa3f6b95e-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-a4008ca0-e353-4408-a4a0-bf9939bdf6d4-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-a4008ca0-e353-4408-a4a0-bf9939bdf6d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55f049-d63f-4ed9-bb85-341966d7e60d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:49 devstack sudo[102094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4
Sep 23 00:28:49 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:49 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" returned: 0 in 0.473s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:49 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4
Sep 23 00:28:49 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:49 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" returned: 0 in 0.359s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-a4008ca0-e353-4408-a4a0-bf9939bdf6d4" released by "delete_volume" :: held 0.927s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['ca104813-16de-442f-9d7c-502b8795b563', 'fbff21b0-bf1b-4661-a13d-58cb3007bd9b', '1d361ef7-ae22-4281-adb2-cb43c93e2abd', '0f6a8379-a402-451c-9c8d-442b1d75cb2e', 'e1eeb7d1-2b0e-46a7-ac7a-39a1a50e4f41'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:50 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:28:50 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:50 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.393s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Deleted volume successfully.
Sep 23 00:28:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2bdb8304-9373-4b60-a4ec-2428fb33cb99 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-a4008ca0-e353-4408-a4a0-bf9939bdf6d4-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (3a3c337e-dfea-4484-ae7f-d7decb087ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9aafe53-d3aa-46fc-8f95-db139a6e1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9aafe53-d3aa-46fc-8f95-db139a6e1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1494147422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2e28c4-d251-40e0-9196-222b2d9e1947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:51Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5df5b9f-e2c2-4ba6-8b61-08a8ac8298c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5df5b9f-e2c2-4ba6-8b61-08a8ac8298c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b7c68c-bf8b-406d-9722-2d0ea3e9e614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b7c68c-bf8b-406d-9722-2d0ea3e9e614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2e28c4-d251-40e0-9196-222b2d9e1947', 'volume_name': 'volume-4f2e28c4-d251-40e0-9196-222b2d9e1947', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0beebeb-0ae9-485d-9ace-900c46b532e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0beebeb-0ae9-485d-9ace-900c46b532e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bfe715-80f4-49a4-9d3a-00910d91de83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:51 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Volume 4f2e28c4-d251-40e0-9196-222b2d9e1947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2e28c4-d251-40e0-9196-222b2d9e1947', 'volume_size': 1}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1494147422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2e28c4-d251-40e0-9196-222b2d9e1947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:51Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Creating volume 4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:51 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:28:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:51 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 1073741824
Sep 23 00:28:51 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:52 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 1073741824" returned: 0 in 0.676s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:52 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947
Sep 23 00:28:52 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:52 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947" returned: 0 in 0.364s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bfe715-80f4-49a4-9d3a-00910d91de83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2e28c4-d251-40e0-9196-222b2d9e1947', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6893e05f-9030-4c6d-8ead-bfcc5fd391a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Volume volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 (4f2e28c4-d251-40e0-9196-222b2d9e1947): created successfully
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6893e05f-9030-4c6d-8ead-bfcc5fd391a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (3a3c337e-dfea-4484-ae7f-d7decb087ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:52 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ed153eef-48d5-4d09-82cd-298153126441 tempest-VolumesSnapshotTestJSON-674914980 None] Created volume successfully.
Sep 23 00:28:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Creating offline snapshot 951c8b01-c04c-4ed3-8ba4-60cf58c596d3 of volume 4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:28:53 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[549e9cf5-0683-4ef2-a2d5-6e2e728a8cc6]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:53 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947
Sep 23 00:28:53 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:54 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947" returned: 0 in 0.644s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:54 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 1G
Sep 23 00:28:54 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:55 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 1G" returned: 0 in 0.741s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:55 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3
Sep 23 00:28:55 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:55 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:55 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 is being set with open permissions: ugo+rw
Sep 23 00:28:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:55 devstack sudo[102132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3
Sep 23 00:28:55 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:55 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3" returned: 0 in 0.357s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:56 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info
Sep 23 00:28:56 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:56 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info" returned: 0 in 0.375s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:56 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info is being set with open permissions: ugo+rw
Sep 23 00:28:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:56 devstack sudo[102138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info
Sep 23 00:28:56 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:56 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.info" returned: 0 in 0.378s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.055s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:56 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-084b2950-a243-4535-a6c7-8ccef7621122 tempest-VolumesSnapshotTestJSON-674914980 None] Create snapshot completed successfully
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (9d0e6a1f-116d-4609-9c0a-51123688f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2717133-ef95-4b07-8020-41600478d482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2717133-ef95-4b07-8020-41600478d482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1289633502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39e86f8-be5e-4056-8cd8-2d2ff51db05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4139e0d1fc1643eb9521b77bbde210df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=951c8b01-c04c-4ed3-8ba4-60cf58c596d3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:58Z,use_quota=True,user_id='0776b960692249ee89903d2d35a4a88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c2e435-2097-4324-8712-dfd918c5a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c2e435-2097-4324-8712-dfd918c5a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1202adc9-4bfd-406f-8087-60e8840b584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1202adc9-4bfd-406f-8087-60e8840b584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c39e86f8-be5e-4056-8cd8-2d2ff51db05a', 'volume_name': 'volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a', 'volume_size': 1, 'snapshot_id': '951c8b01-c04c-4ed3-8ba4-60cf58c596d3'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2d4771-6de3-4608-90cb-1b6132cca404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2d4771-6de3-4608-90cb-1b6132cca404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f183e4-7591-45e3-ba69-10afb2b778ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:57 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Volume c39e86f8-be5e-4056-8cd8-2d2ff51db05a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a', 'volume_size': 1, 'snapshot_id': '951c8b01-c04c-4ed3-8ba4-60cf58c596d3'}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-951c8b01-c04c-4ed3-8ba4-60cf58c596d3-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-951c8b01-c04c-4ed3-8ba4-60cf58c596d3-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Creating volume c39e86f8-be5e-4056-8cd8-2d2ff51db05a from snapshot 951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] snapshot: 951c8b01-c04c-4ed3-8ba4-60cf58c596d3, volume: c39e86f8-be5e-4056-8cd8-2d2ff51db05a,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d5b1b-c7e8-4c5b-9346-8c0a897c0b20]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:58 devstack sudo[102141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3
Sep 23 00:28:58 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:58 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3" returned: 0 in 0.497s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f2e28c4-d251-40e0-9196-222b2d9e1947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88f180-8c8f-42ac-807b-5b2e949f1c2d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:58 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947
Sep 23 00:28:58 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:59 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947" returned: 0 in 0.553s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:28:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:28:59 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:28:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:59 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a
Sep 23 00:28:59 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:07 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" returned: 0 in 8.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:07 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:29:07 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Converted 1024.00 MB image at 121.45 MB/s
Sep 23 00:29:07 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a is being set with open permissions: ugo+rw
Sep 23 00:29:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:07 devstack sudo[102170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a
Sep 23 00:29:07 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:07 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" returned: 0 in 0.316s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:07 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=32,cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" released by "_copy_volume_from_snapshot" :: held 9.952s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-951c8b01-c04c-4ed3-8ba4-60cf58c596d3-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" released by "_create_volume_from_snapshot" :: held 10.068s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.089s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f183e4-7591-45e3-ba69-10afb2b778ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a', 'volume_size': 1, 'snapshot_id': '951c8b01-c04c-4ed3-8ba4-60cf58c596d3'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f52e432-270e-420e-a428-c139ecea71db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:08 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Volume volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a (c39e86f8-be5e-4056-8cd8-2d2ff51db05a): created successfully
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f52e432-270e-420e-a428-c139ecea71db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Flow 'volume_create_manager' (9d0e6a1f-116d-4609-9c0a-51123688f85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5710801b-fe17-47d0-bacb-53f966551a91 tempest-VolumesSnapshotTestJSON-674914980 None] Created volume successfully.
Sep 23 00:29:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-c39e86f8-be5e-4056-8cd8-2d2ff51db05a-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-c39e86f8-be5e-4056-8cd8-2d2ff51db05a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:09 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d7a43-d2b6-47ad-a89c-5868339f49cb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:09 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a
Sep 23 00:29:09 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:10 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" returned: 0 in 0.567s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:10 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a
Sep 23 00:29:10 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:10 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" returned: 0 in 0.368s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-c39e86f8-be5e-4056-8cd8-2d2ff51db05a" released by "delete_volume" :: held 1.000s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['279dfc2b-f7e1-453a-9d0c-822f93de985b', 'ba46b9e0-51ee-4ccf-bbbc-19cdc3128e42', '41c67198-d4d5-44de-90d4-fe8692e1a549', 'c3150cfd-eeec-4fe4-9517-351f0170171c', 'd24cfc19-0825-433a-91a9-cb04b9a82bec'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:10 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:29:10 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:10 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.304s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:10 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Deleted volume successfully.
Sep 23 00:29:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f0196e28-f55b-4373-b1be-7191aa5e96a4 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-c39e86f8-be5e-4056-8cd8-2d2ff51db05a-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-951c8b01-c04c-4ed3-8ba4-60cf58c596d3-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-951c8b01-c04c-4ed3-8ba4-60cf58c596d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-4f2e28c4-d251-40e0-9196-222b2d9e1947" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-4f2e28c4-d251-40e0-9196-222b2d9e1947" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-951c8b01-c04c-4ed3-8ba4-60cf58c596d3" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-951c8b01-c04c-4ed3-8ba4-60cf58c596d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Deleting offline snapshot 951c8b01-c04c-4ed3-8ba4-60cf58c596d3 of volume 4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] snapshot_file for this snap is: volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a12dba1-0736-4105-bfd9-3db70770a3f8]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:11 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3
Sep 23 00:29:11 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:12 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3" returned: 0 in 0.493s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f2e28c4-d251-40e0-9196-222b2d9e1947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:12 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcf9b02-3f6a-4d35-9378-7414702e5c78]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:12 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947
Sep 23 00:29:12 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:13 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947" returned: 0 in 0.777s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:13 devstack sudo[102203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3
Sep 23 00:29:13 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:13 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3" returned: 0 in 0.468s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:13 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3
Sep 23 00:29:13 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:14 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947.951c8b01-c04c-4ed3-8ba4-60cf58c596d3" returned: 0 in 0.432s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-951c8b01-c04c-4ed3-8ba4-60cf58c596d3" released by "_delete_snapshot" :: held 2.359s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-4f2e28c4-d251-40e0-9196-222b2d9e1947" released by "delete_snapshot" :: held 2.392s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:14 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['09704020-89f3-429d-be8b-a9fd29629aab', 'ea696ffc-db46-4c22-bf49-419970a22677', '654ecaab-2deb-4d1a-9bd8-2928a444f052', 'ac675010-5f0d-4428-8645-0fa3b8923b14', '82d271d4-8c72-492e-a169-fc3c8d071322'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Delete snapshot completed successfully.
Sep 23 00:29:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-7ff20884-fb1e-4e6f-9426-690eb625d0b7 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-951c8b01-c04c-4ed3-8ba4-60cf58c596d3-delete_snapshot" released by "delete_snapshot" :: held 2.657s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-4f2e28c4-d251-40e0-9196-222b2d9e1947-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-4f2e28c4-d251-40e0-9196-222b2d9e1947-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-4f2e28c4-d251-40e0-9196-222b2d9e1947" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-4f2e28c4-d251-40e0-9196-222b2d9e1947" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ff510-13dd-4261-b961-24f42c647eca]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:15 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947
Sep 23 00:29:15 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:15 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947" returned: 0 in 0.574s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:15 devstack sudo[102217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947
Sep 23 00:29:15 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:16 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4f2e28c4-d251-40e0-9196-222b2d9e1947" returned: 0 in 0.320s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-4f2e28c4-d251-40e0-9196-222b2d9e1947" released by "delete_volume" :: held 1.011s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['53561e0f-6f3a-45b7-b84f-9167e604776d', '49eb0b92-acf9-4d6a-833e-6f45bddd0967', '1a4efa62-7462-498b-9397-fcf4bd226c13', '622427b2-7917-4d0a-b730-fbd5042412e1', '653a813c-15c5-4b0f-af34-091e72c0da76'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:16 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:29:16 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:16 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Deleted volume successfully.
Sep 23 00:29:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f4bd79c-f461-405f-9377-7da2d38b2f2a tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-4f2e28c4-d251-40e0-9196-222b2d9e1947-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "cinder-quobyte-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48e6933-94b3-4218-8236-320d588754cc]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:18 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb
Sep 23 00:29:18 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:18 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" returned: 0 in 0.781s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:18 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb
Sep 23 00:29:18 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:19 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" returned: 0 in 0.397s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-quobyte-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb" released by "delete_volume" :: held 1.294s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Created reservations ['055f87e1-db57-4e32-bc71-c1add0c76bcd', 'f69c27b9-e498-404d-a361-7e6a884b6fb2', '14cfb869-756e-4676-be67-756515d99557', '2b7b5767-2100-4e88-8f3b-fdb1a521c4b4', 'e1073767-166d-416d-8462-5071dd677c65'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:19 devstack sudo[102231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:29:19 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:19 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.325s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Deleted volume successfully.
Sep 23 00:29:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18bccf9a-3e1d-40c7-b19f-31bff1894138 tempest-VolumesSnapshotTestJSON-674914980 None] Lock "cinder-b6c1df94-c87a-4c11-8520-bc70fa9bb6bb-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Flow 'volume_create_manager' (7e6e7883-4bb1-4dbf-a51a-f0aeab93835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57592c8e-9c33-4987-9244-67d2b5965ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57592c8e-9c33-4987-9244-67d2b5965ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-6995083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ec89fe-088a-4ff8-a4df-7acfecd2a35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c337c1481b5740dbba9d555ab2dcc093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:24Z,use_quota=True,user_id='05657f4579ee4e02bf9e2c781d7b32c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b74da4a-7d44-4bd5-b062-55ebf7303043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b74da4a-7d44-4bd5-b062-55ebf7303043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796bfc4b-f25d-4e04-a07c-0928d0c9a595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796bfc4b-f25d-4e04-a07c-0928d0c9a595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ec89fe-088a-4ff8-a4df-7acfecd2a35e', 'volume_name': 'volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38576c1b-6322-46af-8c4c-a5f028b6a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38576c1b-6322-46af-8c4c-a5f028b6a77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01a4891-38a0-4150-91b3-84f4a7e8d066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:24 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Volume 82ec89fe-088a-4ff8-a4df-7acfecd2a35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e', 'volume_size': 1}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-6995083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ec89fe-088a-4ff8-a4df-7acfecd2a35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c337c1481b5740dbba9d555ab2dcc093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:24Z,use_quota=True,user_id='05657f4579ee4e02bf9e2c781d7b32c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Creating volume 82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:24 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:29:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:24 devstack sudo[102235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e 1073741824
Sep 23 00:29:24 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:25 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e 1073741824" returned: 0 in 0.708s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=65,cinder:INSERT=25,cinder:UPDATE=83,cinder:DELETE=6 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:25 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e
Sep 23 00:29:25 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:25 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" returned: 0 in 0.351s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01a4891-38a0-4150-91b3-84f4a7e8d066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50e2d13-4683-4182-a58f-7503c99eeee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:25 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Volume volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e (82ec89fe-088a-4ff8-a4df-7acfecd2a35e): created successfully
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50e2d13-4683-4182-a58f-7503c99eeee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Flow 'volume_create_manager' (7e6e7883-4bb1-4dbf-a51a-f0aeab93835c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-358723a0-d690-4fc4-92cc-a07d81c6088b tempest-SnapshotDependencyTests-1447099544 None] Created volume successfully.
Sep 23 00:29:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Creating offline snapshot 63798f73-4152-411b-86ae-520465057e81 of volume 82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:29:26 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[63762e8d-4b77-4d91-a695-8b6a3f2024a0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:26 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e
Sep 23 00:29:26 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:27 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" returned: 0 in 0.476s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:27 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 1G
Sep 23 00:29:27 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:27 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 1G" returned: 0 in 0.490s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:27 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81
Sep 23 00:29:27 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:28 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:28 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 is being set with open permissions: ugo+rw
Sep 23 00:29:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:28 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81
Sep 23 00:29:28 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:28 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81" returned: 0 in 0.293s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:28 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info
Sep 23 00:29:28 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:28 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info" returned: 0 in 0.381s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:28 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info is being set with open permissions: ugo+rw
Sep 23 00:29:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:28 devstack sudo[102304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info
Sep 23 00:29:28 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:29 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.info" returned: 0 in 0.305s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1f4a9950-62c7-45f4-8852-1b9104b190f1 tempest-SnapshotDependencyTests-1447099544 None] Create snapshot completed successfully
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Flow 'volume_create_manager' (d3e42723-96a5-4ec6-8b5d-e6574edfc685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f247cdef-32fc-4171-918f-04772cdc8bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f247cdef-32fc-4171-918f-04772cdc8bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a3052d-9147-4b1e-b764-b61d07e432e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c337c1481b5740dbba9d555ab2dcc093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63798f73-4152-411b-86ae-520465057e81,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:31Z,use_quota=True,user_id='05657f4579ee4e02bf9e2c781d7b32c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5954db2b-7eea-44d4-8138-1f29fac0d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5954db2b-7eea-44d4-8138-1f29fac0d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b0b3d4-525b-4440-9f43-b6b746d075e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b0b3d4-525b-4440-9f43-b6b746d075e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5a3052d-9147-4b1e-b764-b61d07e432e6', 'volume_name': 'volume-c5a3052d-9147-4b1e-b764-b61d07e432e6', 'volume_size': 1, 'snapshot_id': '63798f73-4152-411b-86ae-520465057e81'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c829086e-b082-4cd8-b1f1-cd98e9810f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c829086e-b082-4cd8-b1f1-cd98e9810f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8121db7-fb86-4e43-b78d-5ee4afd6939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Volume c5a3052d-9147-4b1e-b764-b61d07e432e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5a3052d-9147-4b1e-b764-b61d07e432e6', 'volume_size': 1, 'snapshot_id': '63798f73-4152-411b-86ae-520465057e81'}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-quobyte-63798f73-4152-411b-86ae-520465057e81-c5a3052d-9147-4b1e-b764-b61d07e432e6" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-63798f73-4152-411b-86ae-520465057e81-c5a3052d-9147-4b1e-b764-b61d07e432e6" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Creating volume c5a3052d-9147-4b1e-b764-b61d07e432e6 from snapshot 63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-quobyte-c5a3052d-9147-4b1e-b764-b61d07e432e6" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-c5a3052d-9147-4b1e-b764-b61d07e432e6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] snapshot: 63798f73-4152-411b-86ae-520465057e81, volume: c5a3052d-9147-4b1e-b764-b61d07e432e6,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e55fc-d45e-4f02-91d0-a3b6b036b042]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:31 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81
Sep 23 00:29:31 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:31 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81" returned: 0 in 0.536s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee041648-f25c-4317-9afc-fbd8886406eb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:31 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e
Sep 23 00:29:31 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:32 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:29:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:29:32 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:29:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:32 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6
Sep 23 00:29:32 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:29:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:40 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:29:40 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:40 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:29:40 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=31,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Flow 'volume_create_manager' (5570e525-3ddb-4a5b-84cb-b96b7b43908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5ca105-80f2-42de-8649-537cc1981b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5ca105-80f2-42de-8649-537cc1981b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-655826363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131c18aa-871a-4711-a176-43372eff90bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5827bd6c064e2b80375295117662b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:41Z,use_quota=True,user_id='e411fdb5cbe241ee9d2436351be61c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60eadac-2e48-41f3-86f1-de2a2abdc14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60eadac-2e48-41f3-86f1-de2a2abdc14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e1c720-626b-412f-bc46-bde386595e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e1c720-626b-412f-bc46-bde386595e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131c18aa-871a-4711-a176-43372eff90bb', 'volume_name': 'volume-131c18aa-871a-4711-a176-43372eff90bb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741a6169-9ccf-48d9-85e9-4e4469c7a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741a6169-9ccf-48d9-85e9-4e4469c7a86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cf24cd-0ccc-423c-afd2-455626e89c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:41 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Volume 131c18aa-871a-4711-a176-43372eff90bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131c18aa-871a-4711-a176-43372eff90bb', 'volume_size': 1}
Sep 23 00:29:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:42 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6" returned: 0 in 10.001s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:29:42 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Converted 1024.00 MB image at 102.37 MB/s
Sep 23 00:29:42 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 is being set with open permissions: ugo+rw
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:42 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6
Sep 23 00:29:42 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Flow 'volume_create_manager' (24e0ba2f-7dd1-4e84-bb0f-09562968752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cd61aa-c9bd-4961-abe4-7287e6e5fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:42 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6" returned: 0 in 0.543s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cd61aa-c9bd-4961-abe4-7287e6e5fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2100032838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6fd2ce-ecf2-4dc6-9792-303ac3094d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5827bd6c064e2b80375295117662b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:42Z,use_quota=True,user_id='e411fdb5cbe241ee9d2436351be61c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199a844c-9087-4a7a-b5d8-9b4155f0a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199a844c-9087-4a7a-b5d8-9b4155f0a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2b5421-faf9-4a41-89af-1561fbafd36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2b5421-faf9-4a41-89af-1561fbafd36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6fd2ce-ecf2-4dc6-9792-303ac3094d54', 'volume_name': 'volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9aa829-e441-4356-8330-08c3c43dab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9aa829-e441-4356-8330-08c3c43dab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8789b686-7ab7-49e8-8f73-956670ebe369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Volume df6fd2ce-ecf2-4dc6-9792-303ac3094d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54', 'volume_size': 1}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-c5a3052d-9147-4b1e-b764-b61d07e432e6" released by "_copy_volume_from_snapshot" :: held 11.782s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-63798f73-4152-411b-86ae-520465057e81-c5a3052d-9147-4b1e-b764-b61d07e432e6" released by "_create_volume_from_snapshot" :: held 11.864s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.881s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-655826363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131c18aa-871a-4711-a176-43372eff90bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5827bd6c064e2b80375295117662b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:41Z,use_quota=True,user_id='e411fdb5cbe241ee9d2436351be61c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Creating volume 131c18aa-871a-4711-a176-43372eff90bb {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:42 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8121db7-fb86-4e43-b78d-5ee4afd6939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a3052d-9147-4b1e-b764-b61d07e432e6', 'volume_size': 1, 'snapshot_id': '63798f73-4152-411b-86ae-520465057e81'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b33978-db70-4212-ab0f-bc84fc79a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:42 devstack sudo[102343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb 1073741824
Sep 23 00:29:42 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Volume volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 (c5a3052d-9147-4b1e-b764-b61d07e432e6): created successfully
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b33978-db70-4212-ab0f-bc84fc79a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Flow 'volume_create_manager' (d3e42723-96a5-4ec6-8b5d-e6574edfc685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c50cbe3b-f5de-49d5-a5da-a877c18c4392 tempest-SnapshotDependencyTests-1447099544 None] Created volume successfully.
Sep 23 00:29:43 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb 1073741824" returned: 0 in 0.806s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:43 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb
Sep 23 00:29:43 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-63798f73-4152-411b-86ae-520465057e81-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-63798f73-4152-411b-86ae-520465057e81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-quobyte-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-quobyte-63798f73-4152-411b-86ae-520465057e81" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-63798f73-4152-411b-86ae-520465057e81" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Deleting offline snapshot 63798f73-4152-411b-86ae-520465057e81 of volume 82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] snapshot_file for this snap is: volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a142b-de7c-4c75-91a1-2a581a6fae27]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:44 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2100032838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6fd2ce-ecf2-4dc6-9792-303ac3094d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5827bd6c064e2b80375295117662b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:42Z,use_quota=True,user_id='e411fdb5cbe241ee9d2436351be61c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Creating volume df6fd2ce-ecf2-4dc6-9792-303ac3094d54 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:44 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cf24cd-0ccc-423c-afd2-455626e89c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131c18aa-871a-4711-a176-43372eff90bb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:44 devstack sudo[102354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81
Sep 23 00:29:44 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:44 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 1073741824
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2332a355-ba93-4d9a-b0e8-2f740dcf40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:44 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:44 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Volume volume-131c18aa-871a-4711-a176-43372eff90bb (131c18aa-871a-4711-a176-43372eff90bb): created successfully
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2332a355-ba93-4d9a-b0e8-2f740dcf40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Flow 'volume_create_manager' (5570e525-3ddb-4a5b-84cb-b96b7b43908c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d57bf0ae-73dd-4340-8c38-c7380e138118 tempest-TestServerVolumeAttachmentScenario-618632028 None] Created volume successfully.
Sep 23 00:29:44 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81" returned: 0 in 0.755s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00bdb21-5618-4e32-8243-8b0a991a4fde]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:44 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e
Sep 23 00:29:44 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:45 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 1073741824" returned: 0 in 0.873s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:45 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54
Sep 23 00:29:45 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:45 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" returned: 0 in 0.774s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:45 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54" returned: 0 in 0.459s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:45 devstack sudo[102375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81
Sep 23 00:29:45 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8789b686-7ab7-49e8-8f73-956670ebe369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583bcdf2-fea7-4208-9e6f-fe2d1f57a21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:45 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Volume volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 (df6fd2ce-ecf2-4dc6-9792-303ac3094d54): created successfully
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583bcdf2-fea7-4208-9e6f-fe2d1f57a21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:45 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Flow 'volume_create_manager' (24e0ba2f-7dd1-4e84-bb0f-09562968752c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-224dcde8-22a7-48fb-9f60-aa6d89a94615 tempest-TestServerVolumeAttachmentScenario-618632028 None] Created volume successfully.
Sep 23 00:29:46 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81" returned: 0 in 0.606s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:46 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81
Sep 23 00:29:46 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:46 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e.63798f73-4152-411b-86ae-520465057e81" returned: 0 in 0.380s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-63798f73-4152-411b-86ae-520465057e81" released by "_delete_snapshot" :: held 2.737s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" released by "delete_snapshot" :: held 2.786s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:46 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Created reservations ['598477c7-4317-4018-8e45-ac1c2d8a1eea', 'df946223-481e-49c9-be23-7eeda7618b02', 'dda41390-1f4b-4443-aae8-5c926331a7ee', '7aca6e3c-67ec-43ce-bc73-519c09c1fbba', '571b2c62-1b8a-4f67-98a3-07984e216819'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Delete snapshot completed successfully.
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3f6e9be4-60e5-4acd-9192-23f44c815c40 tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-63798f73-4152-411b-86ae-520465057e81-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-82ec89fe-088a-4ff8-a4df-7acfecd2a35e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-82ec89fe-088a-4ff8-a4df-7acfecd2a35e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-quobyte-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5e4750-8180-4967-99e6-05a7b6af7334]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:47 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e
Sep 23 00:29:47 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:47 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" returned: 0 in 0.578s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:47 devstack sudo[102390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e
Sep 23 00:29:47 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:48 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-82ec89fe-088a-4ff8-a4df-7acfecd2a35e" released by "delete_volume" :: held 1.125s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Created reservations ['843c2417-f712-4efd-9f2f-32cc87076d2d', 'f0e508d2-ab6a-4f29-980f-dc74d4a493a4', 'e423c2f7-5469-4a7e-8fef-37bd9ef3d828', 'f2c12872-1a9a-487c-b2ef-3723b87dc7a7', '933ae295-a48a-4c05-ad9a-7abf7ec0d945'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:48 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:29:48 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:48 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.323s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Deleted volume successfully.
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-583421d5-a199-42a2-89d0-ebe53a3b574c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-82ec89fe-088a-4ff8-a4df-7acfecd2a35e-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-c5a3052d-9147-4b1e-b764-b61d07e432e6-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-c5a3052d-9147-4b1e-b764-b61d07e432e6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "cinder-quobyte-c5a3052d-9147-4b1e-b764-b61d07e432e6" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-c5a3052d-9147-4b1e-b764-b61d07e432e6" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c911b7f5-6727-4e05-ba48-eaa1228f51fb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:49 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6
Sep 23 00:29:49 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:50 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6" returned: 0 in 0.531s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:50 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6
Sep 23 00:29:50 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:50 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c5a3052d-9147-4b1e-b764-b61d07e432e6" returned: 0 in 0.284s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-quobyte-c5a3052d-9147-4b1e-b764-b61d07e432e6" released by "delete_volume" :: held 0.894s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Created reservations ['1a79e37c-78fe-4f03-b127-e0fb7801e8dc', '265a92ae-5225-49be-907c-043fcdaa7ea9', 'f1de17ba-3cf4-49f1-9106-4578daff6719', 'ea62aaa0-c474-46d4-8ecd-c82dcddfb1aa', 'fc1630fa-3904-4a3a-8fc4-7ff879d6c3a6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:50 devstack sudo[102405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:29:50 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:51 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.386s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:51 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Deleted volume successfully.
Sep 23 00:29:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bd2fbbc-df48-4ca2-bd89-5e7f008ea96c tempest-SnapshotDependencyTests-1447099544 None] Lock "cinder-c5a3052d-9147-4b1e-b764-b61d07e432e6-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Flow 'volume_create_manager' (0dce1de3-6854-4c81-b148-94e74fb2af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4207fa5c-f721-4a79-859c-23553d3d2cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4207fa5c-f721-4a79-859c-23553d3d2cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-993650339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed87e32-5d3e-4fe7-a749-c43968617294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f3cde5adce4722b98e9542240a2752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:56Z,use_quota=True,user_id='cbc715d3825e487b9b5ded6e8880a64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a7d09e-efdc-4042-a815-5a02184bc2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a7d09e-efdc-4042-a815-5a02184bc2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e215b61a-859a-4e15-bed2-e07c1413cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:55 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e215b61a-859a-4e15-bed2-e07c1413cfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ed87e32-5d3e-4fe7-a749-c43968617294', 'volume_name': 'volume-4ed87e32-5d3e-4fe7-a749-c43968617294', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4b9eb40>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a146994-2cda-4fb8-b223-6bd383091883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a146994-2cda-4fb8-b223-6bd383091883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c557631-6c80-4a13-a23d-f921dd2c870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:56 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Volume 4ed87e32-5d3e-4fe7-a749-c43968617294: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ed87e32-5d3e-4fe7-a749-c43968617294', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4b9eb40>}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Trying to clone 4ed87e32-5d3e-4fe7-a749-c43968617294 from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:29:56 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d74e5f6-117b-4ad4-afdc-d1c728f144cf]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:56 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD
Sep 23 00:29:56 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:57 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c is fetched for user cbc715d3825e487b9b5ded6e8880a64b. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38591daf-3360-4742-9842-9e78e7c95e85]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:57 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD
Sep 23 00:29:57 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:57 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-993650339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed87e32-5d3e-4fe7-a749-c43968617294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f3cde5adce4722b98e9542240a2752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:56Z,use_quota=True,user_id='cbc715d3825e487b9b5ded6e8880a64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Creating volume 4ed87e32-5d3e-4fe7-a749-c43968617294 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:57 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:29:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:57 devstack sudo[102443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 1073741824
Sep 23 00:29:57 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:58 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 1073741824" returned: 0 in 0.569s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:58 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294
Sep 23 00:29:58 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:58 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294" returned: 0 in 0.374s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Attempting download of d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 4ed87e32-5d3e-4fe7-a749-c43968617294. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecd17a0-8e3c-4ea9-a802-98ed7ada6558]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:59 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma
Sep 23 00:29:59 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:59 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma" returned: 0 in 0.412s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:59 devstack sudo[102460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma
Sep 23 00:29:59 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:59 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma" returned: 1 in 0.426s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_8l4lfhma' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:29:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ef6c6-a341-49f1-910c-477d05eac801]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:59 devstack sudo[102465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD
Sep 23 00:29:59 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:00 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:00 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] d3316061-b3c0-4b6e-8b31-c56fbf284d8c was qcow2, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:30:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:00 devstack sudo[102470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294
Sep 23 00:30:00 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:02 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294" returned: 0 in 2.755s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:02 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3316061-b3c0-4b6e-8b31-c56fbf284d8c_bhdlb331devstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:30:02 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Converted 112.00 MB image at 40.63 MB/s
Sep 23 00:30:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:02 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 1G
Sep 23 00:30:02 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:03 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 1G" returned: 0 in 0.561s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Downloaded image d3316061-b3c0-4b6e-8b31-c56fbf284d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}])) to volume 4ed87e32-5d3e-4fe7-a749-c43968617294 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Temporary image d3316061-b3c0-4b6e-8b31-c56fbf284d8c for user cbc715d3825e487b9b5ded6e8880a64b is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Marking volume 4ed87e32-5d3e-4fe7-a749-c43968617294 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Copying metadata from image d3316061-b3c0-4b6e-8b31-c56fbf284d8c to 4ed87e32-5d3e-4fe7-a749-c43968617294. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Creating volume glance metadata for volume 4ed87e32-5d3e-4fe7-a749-c43968617294 backed by image d3316061-b3c0-4b6e-8b31-c56fbf284d8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c557631-6c80-4a13-a23d-f921dd2c870f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed87e32-5d3e-4fe7-a749-c43968617294', 'volume_size': 1, 'image_id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4b3a5cfeac49a894aee81052713fca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3316061-b3c0-4b6e-8b31-c56fbf284d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3316061-b3c0-4b6e-8b31-c56fbf284d8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4b9eb40>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fe610a-1034-4d4c-a167-ce95fd927435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:03 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Volume volume-4ed87e32-5d3e-4fe7-a749-c43968617294 (4ed87e32-5d3e-4fe7-a749-c43968617294): created successfully
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fe610a-1034-4d4c-a167-ce95fd927435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Flow 'volume_create_manager' (0dce1de3-6854-4c81-b148-94e74fb2af7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-73ff47e9-1584-4e32-a6f7-1e263003b824 tempest-TestShelveInstance-1974960019 None] Created volume successfully.
Sep 23 00:30:13 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=35,cinder:UPDATE=39,cinder:INSERT=18,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:30:13 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=32,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:30:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-fcd4027d-8ddb-41f0-8363-4c29c22b3991 req-78b3d5a8-56f5-42dc-a7c3-b9bfdd26bdea tempest-TestShelveInstance-1974960019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-fcd4027d-8ddb-41f0-8363-4c29c22b3991 req-78b3d5a8-56f5-42dc-a7c3-b9bfdd26bdea tempest-TestShelveInstance-1974960019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-fcd4027d-8ddb-41f0-8363-4c29c22b3991 req-78b3d5a8-56f5-42dc-a7c3-b9bfdd26bdea tempest-TestShelveInstance-1974960019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-fcd4027d-8ddb-41f0-8363-4c29c22b3991 req-78b3d5a8-56f5-42dc-a7c3-b9bfdd26bdea tempest-TestShelveInstance-1974960019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-4ed87e32-5d3e-4fe7-a749-c43968617294', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19d20972-de09-4c67-8488-34b10e724305', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:30:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-fcd4027d-8ddb-41f0-8363-4c29c22b3991 req-78b3d5a8-56f5-42dc-a7c3-b9bfdd26bdea tempest-TestShelveInstance-1974960019 None] attachment_update completed successfully.
Sep 23 00:30:24 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:30:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Flow 'volume_create_manager' (8966bf7a-ee53-45cc-90b7-6e1670bcd1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:24 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e96dc5-e77f-4e23-8dd1-17d4b22909e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e96dc5-e77f-4e23-8dd1-17d4b22909e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1360839512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e3840e-aecb-445c-b8db-43408956772b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35da69656f354bc8b862ad4dbe56920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:25Z,use_quota=True,user_id='a328b3cbe43d432ab3621253430a94ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c96b0ad-95b5-4547-af5b-84d722aea4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c96b0ad-95b5-4547-af5b-84d722aea4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8557ae59-53a0-4639-adae-5076af5bbba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8557ae59-53a0-4639-adae-5076af5bbba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e3840e-aecb-445c-b8db-43408956772b', 'volume_name': 'volume-a3e3840e-aecb-445c-b8db-43408956772b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758f14fb-065c-4ba7-ab42-3f17117c5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758f14fb-065c-4ba7-ab42-3f17117c5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3ab56f-3449-472e-a1b7-89a192772c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:25 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Volume a3e3840e-aecb-445c-b8db-43408956772b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e3840e-aecb-445c-b8db-43408956772b', 'volume_size': 1}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1360839512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e3840e-aecb-445c-b8db-43408956772b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35da69656f354bc8b862ad4dbe56920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:25Z,use_quota=True,user_id='a328b3cbe43d432ab3621253430a94ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Creating volume a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:30:25 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:25 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b 1073741824
Sep 23 00:30:25 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:25 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b 1073741824" returned: 0 in 0.712s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:25 devstack sudo[103119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b
Sep 23 00:30:25 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:26 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b" returned: 0 in 0.646s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3ab56f-3449-472e-a1b7-89a192772c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e3840e-aecb-445c-b8db-43408956772b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd85757-edfb-405f-a8ac-dc251c090628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:26 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Volume volume-a3e3840e-aecb-445c-b8db-43408956772b (a3e3840e-aecb-445c-b8db-43408956772b): created successfully
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd85757-edfb-405f-a8ac-dc251c090628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Flow 'volume_create_manager' (8966bf7a-ee53-45cc-90b7-6e1670bcd1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fb66eb0a-ee6c-4640-bff5-841e5a673989 tempest-TestStampPattern-1211501220 None] Created volume successfully.
Sep 23 00:30:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8add4523-0c04-4623-bebf-d9a894dbdad0 req-f68f412b-1acc-4691-973f-f71d7d0a06c4 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8add4523-0c04-4623-bebf-d9a894dbdad0 req-f68f412b-1acc-4691-973f-f71d7d0a06c4 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-8add4523-0c04-4623-bebf-d9a894dbdad0 req-f68f412b-1acc-4691-973f-f71d7d0a06c4 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-8add4523-0c04-4623-bebf-d9a894dbdad0 req-f68f412b-1acc-4691-973f-f71d7d0a06c4 tempest-TestServerVolumeAttachmentScenario-618632028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-131c18aa-871a-4711-a176-43372eff90bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40456010-e4bd-43c2-976a-cd56dbcdfcab', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:30:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-8add4523-0c04-4623-bebf-d9a894dbdad0 req-f68f412b-1acc-4691-973f-f71d7d0a06c4 tempest-TestServerVolumeAttachmentScenario-618632028 None] attachment_update completed successfully.
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:40 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:30:40 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:40 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.798s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:30:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:30:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:30:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:30:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-05352856-db9d-4a73-aaae-7ef279c49212 req-7c2afe45-760b-4a5b-984f-51805ca77afd tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-05352856-db9d-4a73-aaae-7ef279c49212 req-7c2afe45-760b-4a5b-984f-51805ca77afd tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-05352856-db9d-4a73-aaae-7ef279c49212 req-7c2afe45-760b-4a5b-984f-51805ca77afd tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-05352856-db9d-4a73-aaae-7ef279c49212 req-7c2afe45-760b-4a5b-984f-51805ca77afd tempest-TestServerVolumeAttachmentScenario-618632028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0796b860-2495-4ad6-826d-296e9bca006f', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:30:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-05352856-db9d-4a73-aaae-7ef279c49212 req-7c2afe45-760b-4a5b-984f-51805ca77afd tempest-TestServerVolumeAttachmentScenario-618632028 None] attachment_update completed successfully.
Sep 23 00:30:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-09bd8234-513a-4d68-8a22-00767bd9e177 req-f4a60336-8877-447a-b1d5-7c3ee4f7ddb2 tempest-TestServerVolumeAttachmentScenario-618632028 None] Terminate volume connection completed successfully.
Sep 23 00:30:44 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-09bd8234-513a-4d68-8a22-00767bd9e177 req-f4a60336-8877-447a-b1d5-7c3ee4f7ddb2 tempest-TestServerVolumeAttachmentScenario-618632028 None] Deleting attachment 0796b860-2495-4ad6-826d-296e9bca006f. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:30:46 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-53af73f8-3264-4926-88df-d91dee738a49 req-2eb53fc3-96b6-497d-acf5-fc0c78ddecfd tempest-TestServerVolumeAttachmentScenario-618632028 None] Terminate volume connection completed successfully.
Sep 23 00:30:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-53af73f8-3264-4926-88df-d91dee738a49 req-2eb53fc3-96b6-497d-acf5-fc0c78ddecfd tempest-TestServerVolumeAttachmentScenario-618632028 None] Deleting attachment 40456010-e4bd-43c2-976a-cd56dbcdfcab. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:30:51 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "cinder-df6fd2ce-ecf2-4dc6-9792-303ac3094d54-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-df6fd2ce-ecf2-4dc6-9792-303ac3094d54-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "cinder-quobyte-df6fd2ce-ecf2-4dc6-9792-303ac3094d54" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-quobyte-df6fd2ce-ecf2-4dc6-9792-303ac3094d54" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a41423-c132-4711-be9e-7bfb846658c7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:52 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54
Sep 23 00:30:52 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:52 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54" returned: 0 in 0.500s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:52 devstack sudo[103372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54
Sep 23 00:30:52 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:53 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-df6fd2ce-ecf2-4dc6-9792-303ac3094d54" returned: 0 in 0.321s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-quobyte-df6fd2ce-ecf2-4dc6-9792-303ac3094d54" released by "delete_volume" :: held 0.882s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Created reservations ['a23183c1-305e-4846-aa51-c9cbeb9ed465', 'bd3a8217-2593-49e7-8660-667e6f648c56', '991bf647-f7bc-4016-8a01-91e2bfbcf17c', '2d556355-400b-419a-80e9-a6a45aaed39b', 'd3a13ef8-7e25-4dd8-8a7d-0ce1e3e24d5c'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:53 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:30:53 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "cinder-131c18aa-871a-4711-a176-43372eff90bb-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-131c18aa-871a-4711-a176-43372eff90bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "cinder-quobyte-131c18aa-871a-4711-a176-43372eff90bb" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-quobyte-131c18aa-871a-4711-a176-43372eff90bb" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3658c5-d823-45a1-b964-4f5d5bdc4cfb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:53 devstack sudo[103377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb
Sep 23 00:30:53 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:53 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:30:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Deleted volume successfully.
Sep 23 00:30:53 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-480b2701-b015-4f47-bfaf-dd10c7afd476 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-df6fd2ce-ecf2-4dc6-9792-303ac3094d54-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:30:54 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:54 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb
Sep 23 00:30:54 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:54 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-131c18aa-871a-4711-a176-43372eff90bb" returned: 0 in 0.341s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-quobyte-131c18aa-871a-4711-a176-43372eff90bb" released by "delete_volume" :: held 0.836s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Created reservations ['57a027a9-9521-4e87-8e75-4ecceba53df9', '29c2fc2b-4bec-4e2e-87e8-429b0d2f84ab', '433f0d64-68b0-407c-97a8-3f2c485f3f32', '4a5283b7-f3ef-4d04-a1d2-b25363e96191', '1b85c4b7-f1f4-4b1a-96a9-b40f97900ce4'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:54 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:30:54 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:55 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.342s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:55 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:30:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Deleted volume successfully.
Sep 23 00:30:55 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6fe6594c-d5ae-4b34-8ce7-ae2fefb0d434 tempest-TestServerVolumeAttachmentScenario-618632028 None] Lock "cinder-131c18aa-871a-4711-a176-43372eff90bb-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-fc5edc81-9d02-4def-857e-9d02e03f319b req-d609fdab-ed5d-44c0-a889-d849ff32aa13 tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-fc5edc81-9d02-4def-857e-9d02e03f319b req-d609fdab-ed5d-44c0-a889-d849ff32aa13 tempest-TestStampPattern-1211501220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-fc5edc81-9d02-4def-857e-9d02e03f319b req-d609fdab-ed5d-44c0-a889-d849ff32aa13 tempest-TestStampPattern-1211501220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-fc5edc81-9d02-4def-857e-9d02e03f319b req-d609fdab-ed5d-44c0-a889-d849ff32aa13 tempest-TestStampPattern-1211501220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-a3e3840e-aecb-445c-b8db-43408956772b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7569e0bf-41ed-475f-b1ab-4db38ee7c3bb', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:31:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-fc5edc81-9d02-4def-857e-9d02e03f319b req-d609fdab-ed5d-44c0-a889-d849ff32aa13 tempest-TestStampPattern-1211501220 None] attachment_update completed successfully.
Sep 23 00:31:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-307a41aa-60f4-43ee-92ab-d9d72021e381 req-e3ff033a-5013-4484-a05b-83eee2938f5e tempest-TestStampPattern-1211501220 None] Terminate volume connection completed successfully.
Sep 23 00:31:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-307a41aa-60f4-43ee-92ab-d9d72021e381 req-e3ff033a-5013-4484-a05b-83eee2938f5e tempest-TestStampPattern-1211501220 None] Deleting attachment 7569e0bf-41ed-475f-b1ab-4db38ee7c3bb. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:31:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Creating offline snapshot 118e3083-1e6c-437d-b683-2a0f58ba57cc of volume a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:31:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d1107e-7f60-49f1-9c39-1a5e3285f2be]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:07 devstack sudo[103449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b
Sep 23 00:31:07 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:08 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b" returned: 0 in 0.493s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:08 devstack sudo[103454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc 1G
Sep 23 00:31:08 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:08 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc 1G" returned: 0 in 0.588s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e3840e-aecb-445c-b8db-43408956772b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:08 devstack sudo[103459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e3840e-aecb-445c-b8db-43408956772b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc
Sep 23 00:31:08 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:09 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e3840e-aecb-445c-b8db-43408956772b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:09 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc is being set with open permissions: ugo+rw
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:09 devstack sudo[103467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc
Sep 23 00:31:09 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:09 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc" returned: 0 in 0.461s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:09 devstack sudo[103487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info
Sep 23 00:31:09 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:09 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-0949d84d-fa39-4789-a370-216d15fb89d2 req-edf8303c-4ef6-40b9-a294-0245bf77d949 tempest-TestShelveInstance-1974960019 None] Terminate volume connection completed successfully.
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-0949d84d-fa39-4789-a370-216d15fb89d2 req-edf8303c-4ef6-40b9-a294-0245bf77d949 tempest-TestShelveInstance-1974960019 None] Deleting attachment 19d20972-de09-4c67-8488-34b10e724305. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:31:09 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info" returned: 0 in 0.384s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:09 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info is being set with open permissions: ugo+rw
Sep 23 00:31:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:09 devstack sudo[103490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info
Sep 23 00:31:09 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:10 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.info" returned: 0 in 0.299s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:10 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6b0699ec-970f-4c60-ae66-13afc9a9d92d tempest-TestStampPattern-1211501220 None] Create snapshot completed successfully
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Flow 'volume_create_manager' (ea689d47-6c1e-4088-80a7-4feb50896380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ff54d6-311a-42a6-8653-a455d84c4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ff54d6-311a-42a6-8653-a455d84c4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632163172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eadd51c-00e7-4c1d-9a31-cea72374d7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088bdaf5788a4803a221680ccec0891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:11Z,use_quota=True,user_id='3ebd16b679504e449d442aae161f342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843064cd-7837-4526-a4f6-0a4511c99587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843064cd-7837-4526-a4f6-0a4511c99587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b6cd65-fd85-4441-ba20-d66d0bf2d886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b6cd65-fd85-4441-ba20-d66d0bf2d886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eadd51c-00e7-4c1d-9a31-cea72374d7ec', 'volume_name': 'volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aff661b-460b-4ec0-9caa-27c065b67669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aff661b-460b-4ec0-9caa-27c065b67669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7010c959-3aa6-4709-9773-ee0250d49ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:10 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Volume 2eadd51c-00e7-4c1d-9a31-cea72374d7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec', 'volume_size': 1}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632163172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eadd51c-00e7-4c1d-9a31-cea72374d7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088bdaf5788a4803a221680ccec0891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:11Z,use_quota=True,user_id='3ebd16b679504e449d442aae161f342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Creating volume 2eadd51c-00e7-4c1d-9a31-cea72374d7ec {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:31:10 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:31:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:10 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec 1073741824
Sep 23 00:31:10 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:11 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec 1073741824" returned: 0 in 0.570s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:11 devstack sudo[103500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec
Sep 23 00:31:11 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:11 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec" returned: 0 in 0.424s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7010c959-3aa6-4709-9773-ee0250d49ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93134397-e9b5-4550-a3db-844c8e3ead8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:11 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Volume volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec (2eadd51c-00e7-4c1d-9a31-cea72374d7ec): created successfully
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93134397-e9b5-4550-a3db-844c8e3ead8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:11 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Flow 'volume_create_manager' (ea689d47-6c1e-4088-80a7-4feb50896380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b15de21a-c2b2-451e-8deb-8db7436bd959 tempest-ProjectReaderTests-1702858673 None] Created volume successfully.
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-4cd98c5c-0e7d-44f2-9c46-5e5f8b413db6 req-be2f8016-161e-48df-b528-87b53e279874 tempest-TestShelveInstance-1974960019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-4cd98c5c-0e7d-44f2-9c46-5e5f8b413db6 req-be2f8016-161e-48df-b528-87b53e279874 tempest-TestShelveInstance-1974960019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-4cd98c5c-0e7d-44f2-9c46-5e5f8b413db6 req-be2f8016-161e-48df-b528-87b53e279874 tempest-TestShelveInstance-1974960019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Acquiring lock "cinder-2eadd51c-00e7-4c1d-9a31-cea72374d7ec-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Lock "cinder-2eadd51c-00e7-4c1d-9a31-cea72374d7ec-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-4cd98c5c-0e7d-44f2-9c46-5e5f8b413db6 req-be2f8016-161e-48df-b528-87b53e279874 tempest-TestShelveInstance-1974960019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-4ed87e32-5d3e-4fe7-a749-c43968617294', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bee2e145-f40d-4718-aba6-091ad515ed54', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Acquiring lock "cinder-quobyte-2eadd51c-00e7-4c1d-9a31-cea72374d7ec" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Lock "cinder-quobyte-2eadd51c-00e7-4c1d-9a31-cea72374d7ec" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd181b18-7001-405d-a58b-c8851df995a5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-4cd98c5c-0e7d-44f2-9c46-5e5f8b413db6 req-be2f8016-161e-48df-b528-87b53e279874 tempest-TestShelveInstance-1974960019 None] attachment_update completed successfully.
Sep 23 00:31:13 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec
Sep 23 00:31:13 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:13 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec" returned: 0 in 0.449s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:13 devstack sudo[103551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec
Sep 23 00:31:13 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:14 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-2eadd51c-00e7-4c1d-9a31-cea72374d7ec" returned: 0 in 0.338s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Lock "cinder-quobyte-2eadd51c-00e7-4c1d-9a31-cea72374d7ec" released by "delete_volume" :: held 0.866s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=59,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Created reservations ['91d1eb3e-95f9-4042-854e-58ff2b2242d1', 'def492f2-f677-4c51-8ea7-05650cf8380e', 'cd6344a0-c3ac-4215-a008-810938ea7221', 'a6f7150e-9f8a-43d3-b628-083b480cb6af', '3f49ee7a-6f0c-495c-b029-51657708e998'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:14 devstack sudo[103554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:31:14 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:14 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.287s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Deleted volume successfully.
Sep 23 00:31:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d503d073-70c4-4b94-8a98-748a32fa080c tempest-ProjectReaderTests-1702858673 None] Lock "cinder-2eadd51c-00e7-4c1d-9a31-cea72374d7ec-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Flow 'volume_create_manager' (849ff160-4a87-44c3-93ce-36cbd1ab387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6291ea-8871-4eb5-bdb0-ef7c798b2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6291ea-8871-4eb5-bdb0-ef7c798b2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411786701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f33d22-65b4-4262-9d9a-a09a144dee75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088bdaf5788a4803a221680ccec0891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='3ebd16b679504e449d442aae161f342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927202d2-a48e-492b-b739-ad2073c24b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927202d2-a48e-492b-b739-ad2073c24b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156d5c3a-f758-48a8-ba72-21b0aaf46f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156d5c3a-f758-48a8-ba72-21b0aaf46f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f33d22-65b4-4262-9d9a-a09a144dee75', 'volume_name': 'volume-07f33d22-65b4-4262-9d9a-a09a144dee75', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9831e146-b722-4bbc-b00f-a40ab1335aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9831e146-b722-4bbc-b00f-a40ab1335aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da53562-93ef-489b-b84a-c924784abeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:16 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Volume 07f33d22-65b4-4262-9d9a-a09a144dee75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f33d22-65b4-4262-9d9a-a09a144dee75', 'volume_size': 1}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411786701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f33d22-65b4-4262-9d9a-a09a144dee75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088bdaf5788a4803a221680ccec0891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='3ebd16b679504e449d442aae161f342f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Creating volume 07f33d22-65b4-4262-9d9a-a09a144dee75 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:31:16 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:31:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:16 devstack sudo[103559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75 1073741824
Sep 23 00:31:16 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:17 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75 1073741824" returned: 0 in 0.764s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:17 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75
Sep 23 00:31:17 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:17 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75" returned: 0 in 0.490s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da53562-93ef-489b-b84a-c924784abeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f33d22-65b4-4262-9d9a-a09a144dee75', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82de5a6-44ed-46d0-8b71-425050cb69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:17 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Volume volume-07f33d22-65b4-4262-9d9a-a09a144dee75 (07f33d22-65b4-4262-9d9a-a09a144dee75): created successfully
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82de5a6-44ed-46d0-8b71-425050cb69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Flow 'volume_create_manager' (849ff160-4a87-44c3-93ce-36cbd1ab387a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-01615a79-3e2b-4e1b-9ef8-8f29ae312419 tempest-ProjectReaderTests-1702858673 None] Created volume successfully.
Sep 23 00:31:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "cinder-07f33d22-65b4-4262-9d9a-a09a144dee75-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Lock "cinder-07f33d22-65b4-4262-9d9a-a09a144dee75-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "cinder-quobyte-07f33d22-65b4-4262-9d9a-a09a144dee75" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Lock "cinder-quobyte-07f33d22-65b4-4262-9d9a-a09a144dee75" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:18 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d8d604-1788-44f1-9be3-8e3883b1e4e2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:18 devstack sudo[104041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75
Sep 23 00:31:18 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:19 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75" returned: 0 in 0.514s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:19 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75
Sep 23 00:31:19 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:19 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-07f33d22-65b4-4262-9d9a-a09a144dee75" returned: 0 in 0.329s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Lock "cinder-quobyte-07f33d22-65b4-4262-9d9a-a09a144dee75" released by "delete_volume" :: held 0.924s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Created reservations ['fd81915d-4a8a-4fcb-bf70-535b59330d52', '84dbf2a0-26f2-41d4-b9ab-d398317593fa', '95193645-3d54-4569-97e5-7667c39c279c', '21edde53-e916-4790-8ede-1a699714051e', '2b749125-58d7-4d32-b4b1-36fd60ff997e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:19 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:31:19 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:20 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.398s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Deleted volume successfully.
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2ffeb6e2-dc6d-497a-9a1f-1f22843c7170 tempest-ProjectReaderTests-1702858673 None] Lock "cinder-07f33d22-65b4-4262-9d9a-a09a144dee75-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Flow 'volume_create_manager' (03b4b5b5-ff53-48fd-a883-8c5b632e8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16042a5a-2433-4e70-aacf-e888fe6ba2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16042a5a-2433-4e70-aacf-e888fe6ba2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-786697879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1741599a-cf14-4fbf-8b31-dce1ac415d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35da69656f354bc8b862ad4dbe56920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=118e3083-1e6c-437d-b683-2a0f58ba57cc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:20Z,use_quota=True,user_id='a328b3cbe43d432ab3621253430a94ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86926903-0b56-4c5f-ad5d-97f0ee133884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86926903-0b56-4c5f-ad5d-97f0ee133884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacaf4e3-b4be-4d66-9fc1-9f0469c8e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacaf4e3-b4be-4d66-9fc1-9f0469c8e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1741599a-cf14-4fbf-8b31-dce1ac415d6e', 'volume_name': 'volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e', 'volume_size': 1, 'snapshot_id': '118e3083-1e6c-437d-b683-2a0f58ba57cc'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539268a2-4f63-4960-8eaf-c15d389b0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539268a2-4f63-4960-8eaf-c15d389b0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67117842-357a-4956-bb03-667f34f7aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:20 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Volume 1741599a-cf14-4fbf-8b31-dce1ac415d6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e', 'volume_size': 1, 'snapshot_id': '118e3083-1e6c-437d-b683-2a0f58ba57cc'}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-quobyte-118e3083-1e6c-437d-b683-2a0f58ba57cc-1741599a-cf14-4fbf-8b31-dce1ac415d6e" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-118e3083-1e6c-437d-b683-2a0f58ba57cc-1741599a-cf14-4fbf-8b31-dce1ac415d6e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Creating volume 1741599a-cf14-4fbf-8b31-dce1ac415d6e from snapshot 118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-quobyte-1741599a-cf14-4fbf-8b31-dce1ac415d6e" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-1741599a-cf14-4fbf-8b31-dce1ac415d6e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] snapshot: 118e3083-1e6c-437d-b683-2a0f58ba57cc, volume: 1741599a-cf14-4fbf-8b31-dce1ac415d6e,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38e951-cf34-437e-8252-15dff68e3d04]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:20 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc
Sep 23 00:31:20 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:21 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc" returned: 0 in 0.574s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3e3840e-aecb-445c-b8db-43408956772b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04f98b1-1900-4649-be24-3a6329b081f3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:21 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b
Sep 23 00:31:21 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:21 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b" returned: 0 in 0.593s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:31:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:21 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e
Sep 23 00:31:21 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:30 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=44,cinder:SELECT=52,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:30 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:33 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e" returned: 0 in 11.901s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:33 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b, size 1024.00 MB, duration 11.90 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:31:33 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Converted 1024.00 MB image at 86.03 MB/s
Sep 23 00:31:33 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e is being set with open permissions: ugo+rw
Sep 23 00:31:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:33 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e
Sep 23 00:31:33 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:34 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e" returned: 0 in 0.302s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-1741599a-cf14-4fbf-8b31-dce1ac415d6e" released by "_copy_volume_from_snapshot" :: held 13.501s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-118e3083-1e6c-437d-b683-2a0f58ba57cc-1741599a-cf14-4fbf-8b31-dce1ac415d6e" released by "_create_volume_from_snapshot" :: held 13.780s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.800s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67117842-357a-4956-bb03-667f34f7aea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e', 'volume_size': 1, 'snapshot_id': '118e3083-1e6c-437d-b683-2a0f58ba57cc'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adc67cb-353a-4515-83f5-9bb81e97035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:34 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Volume volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e (1741599a-cf14-4fbf-8b31-dce1ac415d6e): created successfully
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adc67cb-353a-4515-83f5-9bb81e97035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Flow 'volume_create_manager' (03b4b5b5-ff53-48fd-a883-8c5b632e8a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-35a0e63d-973d-4ad5-aa24-c60ea3b3dd70 tempest-TestStampPattern-1211501220 None] Created volume successfully.
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:39 devstack sudo[104236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:31:39 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:40 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.280s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:31:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:31:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:31:44 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:44 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=2,cinder:INSERT=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-9435b28a-6320-461e-8b28-3ec71359b458 req-dbc6fb1f-036d-41e0-8f9b-91e0ac68d130 tempest-TestShelveInstance-1974960019 None] Terminate volume connection completed successfully.
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-9435b28a-6320-461e-8b28-3ec71359b458 req-dbc6fb1f-036d-41e0-8f9b-91e0ac68d130 tempest-TestShelveInstance-1974960019 None] Deleting attachment bee2e145-f40d-4718-aba6-091ad515ed54. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Acquiring lock "cinder-4ed87e32-5d3e-4fe7-a749-c43968617294-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Lock "cinder-4ed87e32-5d3e-4fe7-a749-c43968617294-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Acquiring lock "cinder-quobyte-4ed87e32-5d3e-4fe7-a749-c43968617294" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Lock "cinder-quobyte-4ed87e32-5d3e-4fe7-a749-c43968617294" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6fcfe4-593a-4f0f-89f9-a56a5b1e19ad]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:59 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294
Sep 23 00:31:59 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:00 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294" returned: 0 in 0.473s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:00 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294
Sep 23 00:32:00 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:00 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4ed87e32-5d3e-4fe7-a749-c43968617294" returned: 0 in 0.365s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Lock "cinder-quobyte-4ed87e32-5d3e-4fe7-a749-c43968617294" released by "delete_volume" :: held 0.906s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG cinder.quota [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Created reservations ['71aa0b7a-938b-46dd-bc85-76387acb76a9', 'ee82c5bd-c6ed-4ed0-8d7f-52ea0536db3d', '82484c22-e39e-443b-b00b-95a6d034862d', '3a722d48-82c9-42e3-a2d9-e3f9cf0d813c', '55bacf99-bb0b-40fe-ad9a-d9908b800b92'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:00 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:00 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:01 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.358s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:01 devstack cinder-volume[87293]: DEBUG cinder.manager [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Deleted volume successfully.
Sep 23 00:32:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [req-9435b28a-6320-461e-8b28-3ec71359b458 req-52d95803-a358-47a1-b2a9-7ab4a562730b tempest-TestShelveInstance-1974960019 None] Lock "cinder-4ed87e32-5d3e-4fe7-a749-c43968617294-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:10 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:32:11 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:32:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-e45a43ef-b876-41a8-826f-dd3f2c436a72 req-632a0dbb-5f86-4cb7-8367-17a6efff9ede tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-e45a43ef-b876-41a8-826f-dd3f2c436a72 req-632a0dbb-5f86-4cb7-8367-17a6efff9ede tempest-TestStampPattern-1211501220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [req-e45a43ef-b876-41a8-826f-dd3f2c436a72 req-632a0dbb-5f86-4cb7-8367-17a6efff9ede tempest-TestStampPattern-1211501220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-e45a43ef-b876-41a8-826f-dd3f2c436a72 req-632a0dbb-5f86-4cb7-8367-17a6efff9ede tempest-TestStampPattern-1211501220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5', 'name': 'volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7462874c-d15d-45d6-b151-a14270fa7303', 'enforce_multipath': True} {{(pid=87293) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:32:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-e45a43ef-b876-41a8-826f-dd3f2c436a72 req-632a0dbb-5f86-4cb7-8367-17a6efff9ede tempest-TestStampPattern-1211501220 None] attachment_update completed successfully.
Sep 23 00:32:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [req-0100cd8b-f09b-4117-b406-1db22c7fdfa5 req-49b51ff6-1a62-4b80-ae98-4b1efe50579c tempest-TestStampPattern-1211501220 None] Terminate volume connection completed successfully.
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [req-0100cd8b-f09b-4117-b406-1db22c7fdfa5 req-49b51ff6-1a62-4b80-ae98-4b1efe50579c tempest-TestStampPattern-1211501220 None] Deleting attachment 7462874c-d15d-45d6-b151-a14270fa7303. {{(pid=87293) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Flow 'volume_create_manager' (9240b55d-1b86-4f2e-b1be-8228b2f19c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1015411b-7b9b-4769-b830-9a6a7ae5a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1015411b-7b9b-4769-b830-9a6a7ae5a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6462476b-a714-4857-9f5e-33b572bab151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4980734e860043bdbc655f8c987e55ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:21Z,use_quota=True,user_id='f868352c713c408f9ece6fe8bd56743a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617cb891-a4de-4209-b1a7-68238f35ac62),volume_type_id=617cb891-a4de-4209-b1a7-68238f35ac62)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cad38b-dec3-468b-8806-f6d50c3365c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cad38b-dec3-468b-8806-f6d50c3365c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bdae25-41c8-4966-9e8c-3be15cd40450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:20 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bdae25-41c8-4966-9e8c-3be15cd40450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6462476b-a714-4857-9f5e-33b572bab151', 'volume_name': 'volume-6462476b-a714-4857-9f5e-33b572bab151', 'volume_size': 1, 'image_id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5716d9ad-280b-43b3-b412-e6d6b8285c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e936d717d827b073499cbd6d928559a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4980734e860043bdbc655f8c987e55ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7112e33f7616edb5b01d0f1e7b1e4ad70f19a14bbb7c1c5d024d286791c63e29babb45e82be3572fa034b12e70ee0531ad97d52e89716491bc187d3f97c016b5', 'id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5716d9ad-280b-43b3-b412-e6d6b8285c32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf0a1fd0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86125b99-7b71-43d1-bbf0-22dc606f5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86125b99-7b71-43d1-bbf0-22dc606f5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23425522-58b5-424a-ad5e-81d0e6b2e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:21 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Volume 6462476b-a714-4857-9f5e-33b572bab151: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6462476b-a714-4857-9f5e-33b572bab151', 'volume_size': 1, 'image_id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5716d9ad-280b-43b3-b412-e6d6b8285c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e936d717d827b073499cbd6d928559a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4980734e860043bdbc655f8c987e55ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7112e33f7616edb5b01d0f1e7b1e4ad70f19a14bbb7c1c5d024d286791c63e29babb45e82be3572fa034b12e70ee0531ad97d52e89716491bc187d3f97c016b5', 'id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5716d9ad-280b-43b3-b412-e6d6b8285c32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf0a1fd0>}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Trying to clone 6462476b-a714-4857-9f5e-33b572bab151 from image 5716d9ad-280b-43b3-b412-e6d6b8285c32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5716d9ad-280b-43b3-b412-e6d6b8285c32', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:32:21 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35462d-468f-425b-8c45-26aad7f89af9]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:21 devstack sudo[104797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD
Sep 23 00:32:21 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:22 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:22 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD
Sep 23 00:32:22 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:22 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Temporary image 5716d9ad-280b-43b3-b412-e6d6b8285c32 is fetched for user f868352c713c408f9ece6fe8bd56743a. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c74028-0c4c-48f3-8e53-aec4b341f4b0]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:23 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD
Sep 23 00:32:23 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:23 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD" returned: 0 in 0.620s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:23 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD
Sep 23 00:32:23 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:23 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD" returned: 1 in 0.507s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6462476b-a714-4857-9f5e-33b572bab151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4980734e860043bdbc655f8c987e55ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:21Z,use_quota=True,user_id='f868352c713c408f9ece6fe8bd56743a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617cb891-a4de-4209-b1a7-68238f35ac62),volume_type_id=617cb891-a4de-4209-b1a7-68238f35ac62)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Creating volume 6462476b-a714-4857-9f5e-33b572bab151 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:23 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:23 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 1073741824
Sep 23 00:32:23 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:24 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 1073741824" returned: 0 in 0.715s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:24 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151
Sep 23 00:32:24 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:25 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151" returned: 0 in 0.304s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Attempting download of 5716d9ad-280b-43b3-b412-e6d6b8285c32 ((None, [{'url': 'file:///opt/stack/data/glance/images/5716d9ad-280b-43b3-b412-e6d6b8285c32', 'metadata': {}}])) to volume 6462476b-a714-4857-9f5e-33b572bab151. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b0dc6-0c79-4cf2-93d4-2f4cea2696fe]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:25 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g
Sep 23 00:32:25 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-1741599a-cf14-4fbf-8b31-dce1ac415d6e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Lock "cinder-1741599a-cf14-4fbf-8b31-dce1ac415d6e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:25 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g" returned: 0 in 0.379s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-quobyte-1741599a-cf14-4fbf-8b31-dce1ac415d6e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-1741599a-cf14-4fbf-8b31-dce1ac415d6e" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4541845-617e-45d7-bdb8-0431c2fa1477]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:25 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g
Sep 23 00:32:25 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:25 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e
Sep 23 00:32:25 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:25 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g" returned: 1 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5716d9ad-280b-43b3-b412-e6d6b8285c32_yolqcz6g' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc4dc99-a4d3-4300-996c-4893f4dd8982]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[104862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD
Sep 23 00:32:26 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e" returned: 0 in 0.513s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e
Sep 23 00:32:26 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1741599a-cf14-4fbf-8b31-dce1ac415d6e" returned: 0 in 0.293s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-1741599a-cf14-4fbf-8b31-dce1ac415d6e" released by "delete_volume" :: held 0.856s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:26 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD
Sep 23 00:32:26 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Created reservations ['91d469e2-5fba-45fc-b29b-d2a3b1f08523', '260386ce-4372-45bb-86f1-e2367b8bffb8', 'bed652a1-1609-489b-93e7-1646e0c38cca', '1212d0a2-f3b4-4142-8bc9-b0523596ccda', '548d051a-73ec-404d-bcea-4a93eee1d0d1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[104874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:26 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] 5716d9ad-280b-43b3-b412-e6d6b8285c32 was raw, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151
Sep 23 00:32:26 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-118e3083-1e6c-437d-b683-2a0f58ba57cc-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.431s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Deleted volume successfully.
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Lock "cinder-118e3083-1e6c-437d-b683-2a0f58ba57cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-quobyte-a3e3840e-aecb-445c-b8db-43408956772b" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-a3e3840e-aecb-445c-b8db-43408956772b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-quobyte-118e3083-1e6c-437d-b683-2a0f58ba57cc" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-47f9eede-eda0-4780-81b2-d11775e7869b tempest-TestStampPattern-1211501220 None] Lock "cinder-1741599a-cf14-4fbf-8b31-dce1ac415d6e-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-118e3083-1e6c-437d-b683-2a0f58ba57cc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Deleting offline snapshot 118e3083-1e6c-437d-b683-2a0f58ba57cc of volume a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] snapshot_file for this snap is: volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ee3e6e-e873-4602-b8bb-0bddf7f6c7e1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:27 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151" returned: 0 in 0.585s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5716d9ad-280b-43b3-b412-e6d6b8285c32_cqntu_nfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:32:27 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:27 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc
Sep 23 00:32:27 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:27 devstack sudo[104888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 1G
Sep 23 00:32:27 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:27 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc" returned: 0 in 0.462s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3e3840e-aecb-445c-b8db-43408956772b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b515b8-7948-4689-8307-273dd85031f1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:27 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 1G" returned: 0 in 0.365s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Downloaded image 5716d9ad-280b-43b3-b412-e6d6b8285c32 ((None, [{'url': 'file:///opt/stack/data/glance/images/5716d9ad-280b-43b3-b412-e6d6b8285c32', 'metadata': {}}])) to volume 6462476b-a714-4857-9f5e-33b572bab151 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Temporary image 5716d9ad-280b-43b3-b412-e6d6b8285c32 for user f868352c713c408f9ece6fe8bd56743a is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Marking volume 6462476b-a714-4857-9f5e-33b572bab151 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Copying metadata from image 5716d9ad-280b-43b3-b412-e6d6b8285c32 to 6462476b-a714-4857-9f5e-33b572bab151. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Creating volume glance metadata for volume 6462476b-a714-4857-9f5e-33b572bab151 backed by image 5716d9ad-280b-43b3-b412-e6d6b8285c32 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e936d717d827b073499cbd6d928559a2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23425522-58b5-424a-ad5e-81d0e6b2e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6462476b-a714-4857-9f5e-33b572bab151', 'volume_size': 1, 'image_id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5716d9ad-280b-43b3-b412-e6d6b8285c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e936d717d827b073499cbd6d928559a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4980734e860043bdbc655f8c987e55ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7112e33f7616edb5b01d0f1e7b1e4ad70f19a14bbb7c1c5d024d286791c63e29babb45e82be3572fa034b12e70ee0531ad97d52e89716491bc187d3f97c016b5', 'id': '5716d9ad-280b-43b3-b412-e6d6b8285c32', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5716d9ad-280b-43b3-b412-e6d6b8285c32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf0a1fd0>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152df0cf-95e0-4256-9e03-1b2634a1f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:27 devstack sudo[104897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b
Sep 23 00:32:27 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Volume volume-6462476b-a714-4857-9f5e-33b572bab151 (6462476b-a714-4857-9f5e-33b572bab151): created successfully
Sep 23 00:32:27 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152df0cf-95e0-4256-9e03-1b2634a1f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Flow 'volume_create_manager' (9240b55d-1b86-4f2e-b1be-8228b2f19c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-185c19a8-e26c-4c24-a3d0-69b55a047202 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Created volume successfully.
Sep 23 00:32:28 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b" returned: 0 in 0.575s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:28 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc
Sep 23 00:32:28 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:28 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc" returned: 0 in 0.384s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Acquiring lock "cinder-6462476b-a714-4857-9f5e-33b572bab151-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:28 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc
Sep 23 00:32:28 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "cinder-6462476b-a714-4857-9f5e-33b572bab151-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Acquiring lock "cinder-quobyte-6462476b-a714-4857-9f5e-33b572bab151" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "cinder-quobyte-6462476b-a714-4857-9f5e-33b572bab151" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26c5e46-6a9b-45b2-80fb-2fad46dcf758]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:28 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151
Sep 23 00:32:28 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:28 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b.118e3083-1e6c-437d-b683-2a0f58ba57cc" returned: 0 in 0.354s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-118e3083-1e6c-437d-b683-2a0f58ba57cc" released by "_delete_snapshot" :: held 1.922s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-a3e3840e-aecb-445c-b8db-43408956772b" released by "delete_snapshot" :: held 1.958s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Created reservations ['303a689b-d843-4bb7-8c51-e183f8412e20', '0397afb5-9e1e-40bf-b2f5-f8f6bcf6be74', '63747c53-9c94-4783-9417-9e12f1789250', '5134e9eb-0faf-47e5-b60f-899cf1665001', '7de4526f-48ea-47c3-9049-2226ce343e4c'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Delete snapshot completed successfully.
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3cd7eeb3-b0ed-4b9d-957c-9e4000042e1c tempest-TestStampPattern-1211501220 None] Lock "cinder-118e3083-1e6c-437d-b683-2a0f58ba57cc-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:29 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151" returned: 0 in 0.514s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:29 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151
Sep 23 00:32:29 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:29 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6462476b-a714-4857-9f5e-33b572bab151" returned: 0 in 0.279s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "cinder-quobyte-6462476b-a714-4857-9f5e-33b572bab151" released by "delete_volume" :: held 0.861s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:29 devstack cinder-volume[87293]: WARNING cinder.quota [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:32:29 devstack cinder-volume[87293]: WARNING cinder.quota [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Created reservations ['43d9fec1-7837-47d9-8aa1-fcc84191268b', 'b3f96885-eb83-4e1f-bbb4-14c327087a2a', 'f9af4f75-7386-4880-a64f-27505948e9ee', '7059f65e-95c5-45c5-89a4-80faedaef5ee', '4cabffed-79ad-4cbb-b4c4-6814249cfba1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:29 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:29 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:30 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.312s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:30 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:30 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Deleted volume successfully.
Sep 23 00:32:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c285902a-ec87-4acf-a624-088234939ab4 tempest-VolumeAndVolumeTypeFromImageTest-132696053 None] Lock "cinder-6462476b-a714-4857-9f5e-33b572bab151-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-a3e3840e-aecb-445c-b8db-43408956772b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Lock "cinder-a3e3840e-aecb-445c-b8db-43408956772b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Acquiring lock "cinder-quobyte-a3e3840e-aecb-445c-b8db-43408956772b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-a3e3840e-aecb-445c-b8db-43408956772b" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a43ddb-1d5a-403f-a9da-3e3a323e503d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:35 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b
Sep 23 00:32:35 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:35 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b" returned: 0 in 0.440s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:35 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b
Sep 23 00:32:35 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:35 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a3e3840e-aecb-445c-b8db-43408956772b" returned: 0 in 0.297s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Lock "cinder-quobyte-a3e3840e-aecb-445c-b8db-43408956772b" released by "delete_volume" :: held 0.827s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:35 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Created reservations ['912c7f9c-4393-4ce2-9ef0-65adfab56b0a', 'dedd834c-7f77-4881-8401-383d8d5f47de', 'ef3ebf0e-a7c1-4502-8057-d13767d10c31', '54eddb1f-cc36-490d-b101-fa51fbc2cee2', 'e1fbffb9-582a-48a4-bc4a-5267e55afbd9'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:36 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:36 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (afff8685-20d8-451e-9861-cf7461b4386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c4ac69-1078-4563-b265-9274c09a0c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c4ac69-1078-4563-b265-9274c09a0c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234264458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f2df50-1814-4b29-868e-8beddedf61c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:36Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cbac0f-9e8d-489f-a382-4729a967e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cbac0f-9e8d-489f-a382-4729a967e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f836ba44-2578-4f7c-8044-382a1a15ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f836ba44-2578-4f7c-8044-382a1a15ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f2df50-1814-4b29-868e-8beddedf61c1', 'volume_name': 'volume-83f2df50-1814-4b29-868e-8beddedf61c1', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bcb72a-5e7f-4546-b910-b79e45c9d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bcb72a-5e7f-4546-b910-b79e45c9d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d255d6e-0b99-46c1-ae76-c1a9362aa6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Volume 83f2df50-1814-4b29-868e-8beddedf61c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f2df50-1814-4b29-868e-8beddedf61c1', 'volume_size': 1}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234264458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f2df50-1814-4b29-868e-8beddedf61c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:36Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Creating volume 83f2df50-1814-4b29-868e-8beddedf61c1 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:36 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:36 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.372s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Deleted volume successfully.
Sep 23 00:32:36 devstack sudo[104998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1 1073741824
Sep 23 00:32:36 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f4539b2b-9a05-4369-af9d-fb2a1201f79b tempest-TestStampPattern-1211501220 None] Lock "cinder-a3e3840e-aecb-445c-b8db-43408956772b-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (24b44b6c-006a-420f-8eb0-40cc72fd547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005c6f0d-3aa9-40f9-9fac-431c89cae510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005c6f0d-3aa9-40f9-9fac-431c89cae510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438198575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246d1f96-2957-401e-920c-46fbd82e303f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:37Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c3abee-628e-4114-be22-686424061547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c3abee-628e-4114-be22-686424061547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0495360-38b0-43fb-bfd0-70d8aa718176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0495360-38b0-43fb-bfd0-70d8aa718176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246d1f96-2957-401e-920c-46fbd82e303f', 'volume_name': 'volume-246d1f96-2957-401e-920c-46fbd82e303f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8100fd-fe82-438b-a5a3-4a6bdfa4d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8100fd-fe82-438b-a5a3-4a6bdfa4d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c766f8fe-eb7e-45ab-97e1-86ee0d511f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Volume 246d1f96-2957-401e-920c-46fbd82e303f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246d1f96-2957-401e-920c-46fbd82e303f', 'volume_size': 1}
Sep 23 00:32:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:37 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1 1073741824" returned: 0 in 0.801s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:37 devstack sudo[105004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1
Sep 23 00:32:37 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (1844f567-628e-4bf7-a643-94c09e349b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b23114-3cc7-4335-a9ac-962338a5759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b23114-3cc7-4335-a9ac-962338a5759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057755044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e19b7-02ac-4b13-9f52-951183ef0ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:37Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6670ae55-d2b9-44d5-ae96-26b42fe1dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6670ae55-d2b9-44d5-ae96-26b42fe1dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a141eb-f839-40da-b858-c235d8e6c4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a141eb-f839-40da-b858-c235d8e6c4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30e19b7-02ac-4b13-9f52-951183ef0ede', 'volume_name': 'volume-c30e19b7-02ac-4b13-9f52-951183ef0ede', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f98302-9df5-49fc-8b23-7cc9f076997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f98302-9df5-49fc-8b23-7cc9f076997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f9c47-a605-4443-9390-887fc6cd8a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Volume c30e19b7-02ac-4b13-9f52-951183ef0ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30e19b7-02ac-4b13-9f52-951183ef0ede', 'volume_size': 1}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:37 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1" returned: 0 in 0.356s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438198575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246d1f96-2957-401e-920c-46fbd82e303f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:37Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Creating volume 246d1f96-2957-401e-920c-46fbd82e303f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:37 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d255d6e-0b99-46c1-ae76-c1a9362aa6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f2df50-1814-4b29-868e-8beddedf61c1', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05423958-a626-4298-bec9-ec9e6d6bfa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Volume volume-83f2df50-1814-4b29-868e-8beddedf61c1 (83f2df50-1814-4b29-868e-8beddedf61c1): created successfully
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05423958-a626-4298-bec9-ec9e6d6bfa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:37 devstack sudo[105007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f 1073741824
Sep 23 00:32:37 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (afff8685-20d8-451e-9861-cf7461b4386c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:37 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2f82301f-74dc-4acf-8ee4-9da07438e357 tempest-CreateVolumesFromImageTest-1980449550 None] Created volume successfully.
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (a6032750-e737-4723-9a59-3a07b8667528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff050d9-f9fc-4428-90f8-e5a61dbc7df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff050d9-f9fc-4428-90f8-e5a61dbc7df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084737647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b28ca1-b79c-436e-9916-bf136ff72da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:38Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28679dba-26a4-430a-a8f5-4f88ac19d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28679dba-26a4-430a-a8f5-4f88ac19d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b658d9-87f4-4c0d-9895-9e14c05ca68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b658d9-87f4-4c0d-9895-9e14c05ca68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b28ca1-b79c-436e-9916-bf136ff72da9', 'volume_name': 'volume-47b28ca1-b79c-436e-9916-bf136ff72da9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199de98c-5ce5-48d5-85cf-7fca79d41d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199de98c-5ce5-48d5-85cf-7fca79d41d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569543fd-3f9d-49a4-9bae-c5a29adbb86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Volume 47b28ca1-b79c-436e-9916-bf136ff72da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b28ca1-b79c-436e-9916-bf136ff72da9', 'volume_size': 1}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:38 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f 1073741824" returned: 0 in 0.897s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (064dbf5d-d14f-4c6f-88b4-1e53da414e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98629349-6e21-4f9a-be46-6ede1b554b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98629349-6e21-4f9a-be46-6ede1b554b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-525931080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4695e623-28bc-4575-b944-c691a6c74231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:38Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea120f-1b06-4498-9152-f9a3a40aa03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea120f-1b06-4498-9152-f9a3a40aa03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d06029-8949-4cd1-a0e4-22c6bc2568ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d06029-8949-4cd1-a0e4-22c6bc2568ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4695e623-28bc-4575-b944-c691a6c74231', 'volume_name': 'volume-4695e623-28bc-4575-b944-c691a6c74231', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3249a5c1-8e01-402b-a1ce-b1e251bf52a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3249a5c1-8e01-402b-a1ce-b1e251bf52a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c6999-19cc-46e1-bc6e-0cbd810d1364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Volume 4695e623-28bc-4575-b944-c691a6c74231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4695e623-28bc-4575-b944-c691a6c74231', 'volume_size': 1}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:38 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f
Sep 23 00:32:38 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:38 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f" returned: 0 in 0.296s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057755044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e19b7-02ac-4b13-9f52-951183ef0ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:37Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Creating volume c30e19b7-02ac-4b13-9f52-951183ef0ede {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:38 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c766f8fe-eb7e-45ab-97e1-86ee0d511f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246d1f96-2957-401e-920c-46fbd82e303f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b86e12b-f049-4937-a86a-f0ec56bb1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:38 devstack sudo[105016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede 1073741824
Sep 23 00:32:38 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Volume volume-246d1f96-2957-401e-920c-46fbd82e303f (246d1f96-2957-401e-920c-46fbd82e303f): created successfully
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b86e12b-f049-4937-a86a-f0ec56bb1f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (24b44b6c-006a-420f-8eb0-40cc72fd547d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8681c516-68e4-422b-963a-75f52582360b tempest-CreateVolumesFromImageTest-1980449550 None] Created volume successfully.
Sep 23 00:32:39 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede 1073741824" returned: 0 in 0.550s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:39 devstack sudo[105023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede
Sep 23 00:32:39 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:39 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede" returned: 0 in 0.324s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084737647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b28ca1-b79c-436e-9916-bf136ff72da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:38Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Creating volume 47b28ca1-b79c-436e-9916-bf136ff72da9 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:39 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f9c47-a605-4443-9390-887fc6cd8a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30e19b7-02ac-4b13-9f52-951183ef0ede', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0640a5d9-81fd-41b0-ac80-8553e79ec57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:39 devstack sudo[105026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9 1073741824
Sep 23 00:32:39 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Volume volume-c30e19b7-02ac-4b13-9f52-951183ef0ede (c30e19b7-02ac-4b13-9f52-951183ef0ede): created successfully
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0640a5d9-81fd-41b0-ac80-8553e79ec57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (1844f567-628e-4bf7-a643-94c09e349b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:40 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-20b3b548-d758-4867-9cfb-adf2339f4aa2 tempest-CreateVolumesFromImageTest-1980449550 None] Created volume successfully.
Sep 23 00:32:40 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:40 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:40 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.293s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:32:40 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9 1073741824" returned: 0 in 0.594s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:40 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9
Sep 23 00:32:40 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:40 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9" returned: 0 in 0.375s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-525931080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4695e623-28bc-4575-b944-c691a6c74231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cdb03dd65473689cbe380d0e2ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:38Z,use_quota=True,user_id='040f20a0e73441c18fbea247757a7943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Creating volume 4695e623-28bc-4575-b944-c691a6c74231 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:40 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569543fd-3f9d-49a4-9bae-c5a29adbb86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b28ca1-b79c-436e-9916-bf136ff72da9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dd7aa8-ffda-49bf-ba8a-8ccfbc82132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:40 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231 1073741824
Sep 23 00:32:40 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:40 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Volume volume-47b28ca1-b79c-436e-9916-bf136ff72da9 (47b28ca1-b79c-436e-9916-bf136ff72da9): created successfully
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dd7aa8-ffda-49bf-ba8a-8ccfbc82132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (a6032750-e737-4723-9a59-3a07b8667528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7c88b3e1-82dc-4f3e-a42f-7781279ef93e tempest-CreateVolumesFromImageTest-1980449550 None] Created volume successfully.
Sep 23 00:32:41 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231 1073741824" returned: 0 in 0.592s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:41 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231
Sep 23 00:32:41 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:41 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231" returned: 0 in 0.406s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c6999-19cc-46e1-bc6e-0cbd810d1364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4695e623-28bc-4575-b944-c691a6c74231', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea339c42-dd8e-4288-b4ac-cc6e325c8615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Volume volume-4695e623-28bc-4575-b944-c691a6c74231 (4695e623-28bc-4575-b944-c691a6c74231): created successfully
Sep 23 00:32:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea339c42-dd8e-4288-b4ac-cc6e325c8615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Flow 'volume_create_manager' (064dbf5d-d14f-4c6f-88b4-1e53da414e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-79a451e9-539d-45e4-8a32-4cfe91751635 tempest-CreateVolumesFromImageTest-1980449550 None] Created volume successfully.
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-4695e623-28bc-4575-b944-c691a6c74231-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-4695e623-28bc-4575-b944-c691a6c74231-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-quobyte-4695e623-28bc-4575-b944-c691a6c74231" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-4695e623-28bc-4575-b944-c691a6c74231" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c35e74-50bd-4461-b1ba-e8f624cb37f1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:43 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231
Sep 23 00:32:43 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:43 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231" returned: 0 in 0.467s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:43 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231
Sep 23 00:32:43 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:44 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4695e623-28bc-4575-b944-c691a6c74231" returned: 0 in 0.307s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-4695e623-28bc-4575-b944-c691a6c74231" released by "delete_volume" :: held 0.845s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Created reservations ['3116328e-1054-4cdc-9b75-d0bf3d49f5cd', '74e40f9d-a896-4c7d-b8cd-9342c0a28048', 'df282c1e-fb79-47e3-a7ee-a5dcfc755a00', '50e6dc30-0f72-441b-a14f-082212a5f405', '2b25fcdb-9a34-46f1-a452-991b50857043'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:44 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:44 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-47b28ca1-b79c-436e-9916-bf136ff72da9-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-47b28ca1-b79c-436e-9916-bf136ff72da9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-quobyte-47b28ca1-b79c-436e-9916-bf136ff72da9" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-47b28ca1-b79c-436e-9916-bf136ff72da9" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37150e9-e0df-4dbb-8266-1fe8b30615aa]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:44 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.456s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Deleted volume successfully.
Sep 23 00:32:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-18158310-9630-42a5-a118-05cc594660c9 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-4695e623-28bc-4575-b944-c691a6c74231-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:44 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9
Sep 23 00:32:44 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:45 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9" returned: 0 in 0.455s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:45 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9
Sep 23 00:32:45 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:45 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-47b28ca1-b79c-436e-9916-bf136ff72da9" returned: 0 in 0.305s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-47b28ca1-b79c-436e-9916-bf136ff72da9" released by "delete_volume" :: held 0.836s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Created reservations ['684102ea-7629-46c1-aa3c-ffb562b8b727', '8d114fcf-4e26-4b84-b5a3-0b6087a73289', '0598ba61-fd6f-4902-90b8-5416621b8631', 'a0501144-d1f4-471e-a53f-22e58b7278a1', 'eccedf38-eaa2-4fb6-9dda-a8108547d690'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:45 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:45 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-c30e19b7-02ac-4b13-9f52-951183ef0ede-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-c30e19b7-02ac-4b13-9f52-951183ef0ede-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-quobyte-c30e19b7-02ac-4b13-9f52-951183ef0ede" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-c30e19b7-02ac-4b13-9f52-951183ef0ede" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7972bf6-4a9f-43b7-bdd4-38e8e723946d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:45 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:45 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Deleted volume successfully.
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e2ac496e-78bf-4094-a315-3f904913b3d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-47b28ca1-b79c-436e-9916-bf136ff72da9-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:46 devstack sudo[105073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede
Sep 23 00:32:46 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:46 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede" returned: 0 in 0.499s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:46 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede
Sep 23 00:32:46 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:46 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c30e19b7-02ac-4b13-9f52-951183ef0ede" returned: 0 in 0.285s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-c30e19b7-02ac-4b13-9f52-951183ef0ede" released by "delete_volume" :: held 0.838s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Created reservations ['43872b14-d54d-4925-8c7c-e64be62f3e49', 'ba971bfe-3849-4d9b-b74b-208878f2eeec', '7108eeb9-e355-43e5-b5cb-d0d451a079cd', 'fe285863-755c-4dd3-b644-829ede82f9eb', '06b5e300-0176-4de5-b96d-fe95c80a5220'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:46 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:46 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-246d1f96-2957-401e-920c-46fbd82e303f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-246d1f96-2957-401e-920c-46fbd82e303f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-quobyte-246d1f96-2957-401e-920c-46fbd82e303f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-246d1f96-2957-401e-920c-46fbd82e303f" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7793f7a-75ba-4fc0-b5dd-542d9e741b32]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:47 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.461s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Deleted volume successfully.
Sep 23 00:32:47 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f
Sep 23 00:32:47 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3abfffb2-1c71-4f95-a43b-c031310511d0 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-c30e19b7-02ac-4b13-9f52-951183ef0ede-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:47 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f" returned: 0 in 0.598s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:47 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f
Sep 23 00:32:47 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:48 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-246d1f96-2957-401e-920c-46fbd82e303f" returned: 0 in 0.312s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-246d1f96-2957-401e-920c-46fbd82e303f" released by "delete_volume" :: held 0.970s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Created reservations ['fd0e3f4a-6483-4c4c-994a-c9b32c9a50fc', '786957aa-1d08-4e10-bd4f-5361056de0b2', '39a3c05d-3e10-47f4-90d6-a32a7997d133', 'dbc2c365-a5f0-4534-b204-76574b71b6ce', 'cccda575-d931-4175-8d52-845acf800743'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:48 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:48 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:48 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.285s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Deleted volume successfully.
Sep 23 00:32:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c28f7ca2-42cf-4a30-9671-dbec55ab2e29 tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-246d1f96-2957-401e-920c-46fbd82e303f-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-83f2df50-1814-4b29-868e-8beddedf61c1-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-83f2df50-1814-4b29-868e-8beddedf61c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "cinder-quobyte-83f2df50-1814-4b29-868e-8beddedf61c1" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-83f2df50-1814-4b29-868e-8beddedf61c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85dfc7e-8dfd-4d1e-8585-d43d57536984]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:49 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1
Sep 23 00:32:49 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:49 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1" returned: 0 in 0.531s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:50 devstack sudo[105102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1
Sep 23 00:32:50 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:50 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83f2df50-1814-4b29-868e-8beddedf61c1" returned: 0 in 0.302s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-quobyte-83f2df50-1814-4b29-868e-8beddedf61c1" released by "delete_volume" :: held 0.895s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Created reservations ['9c980647-e12d-4962-a50a-1fbfaf080b7a', 'fb38b5c3-aa6a-431e-88d9-cd2f84fd6246', '856c8ece-16c4-4a99-b79d-d967bd3117b0', '7db9289d-c2ef-4178-ab57-49b10e34022e', '0893db5f-82af-4f73-b0c0-ccff758ccc00'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:50 devstack sudo[105105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:32:50 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:50 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.316s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Deleted volume successfully.
Sep 23 00:32:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07b2fa60-e6f5-486d-9ff4-8570093a9e5d tempest-CreateVolumesFromImageTest-1980449550 None] Lock "cinder-83f2df50-1814-4b29-868e-8beddedf61c1-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (f0929800-cc4b-4224-9fce-57f2ea0f6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8fb5a3-d2ee-433c-95bd-fba0607285d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8fb5a3-d2ee-433c-95bd-fba0607285d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1332748386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fecd01-9835-443e-8ad6-7432d653b7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:53Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db83084e-b767-45fa-bfb5-fdb06d3adca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db83084e-b767-45fa-bfb5-fdb06d3adca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daed702-c187-41bf-833b-8441f3e2c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daed702-c187-41bf-833b-8441f3e2c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fecd01-9835-443e-8ad6-7432d653b7ae', 'volume_name': 'volume-46fecd01-9835-443e-8ad6-7432d653b7ae', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e9d86-b89e-4c19-9360-e499fc6ae9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e9d86-b89e-4c19-9360-e499fc6ae9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c274c0a-2b0f-4451-9deb-8184ab93eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:53 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume 46fecd01-9835-443e-8ad6-7432d653b7ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fecd01-9835-443e-8ad6-7432d653b7ae', 'volume_size': 1}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1332748386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fecd01-9835-443e-8ad6-7432d653b7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:53Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating volume 46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:53 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:53 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae 1073741824
Sep 23 00:32:53 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:53 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae 1073741824" returned: 0 in 0.539s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:53 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae
Sep 23 00:32:53 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:54 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae" returned: 0 in 0.291s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c274c0a-2b0f-4451-9deb-8184ab93eefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fecd01-9835-443e-8ad6-7432d653b7ae', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb8fcca-1884-432f-9d42-71486751ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:54 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume volume-46fecd01-9835-443e-8ad6-7432d653b7ae (46fecd01-9835-443e-8ad6-7432d653b7ae): created successfully
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb8fcca-1884-432f-9d42-71486751ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (f0929800-cc4b-4224-9fce-57f2ea0f6d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:54 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4c13e719-f1ef-4e18-b90f-83c3f571ff17 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created volume successfully.
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Flow 'volume_create_manager' (57e52f14-d5f2-45e2-9dbb-1f1d7aee60a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9385668c-b1be-4a43-8109-d44114ddbebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9385668c-b1be-4a43-8109-d44114ddbebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1444053136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1042646e-00ec-4817-939e-4b26c9f4a406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c121eeb43a8486e96819a6e7caacfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:55Z,use_quota=True,user_id='a90df285d7944a6388d861da8b5250b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3975be-46a5-43f5-81eb-f435fff643dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3975be-46a5-43f5-81eb-f435fff643dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac46320-b160-47be-a6b8-442524246ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac46320-b160-47be-a6b8-442524246ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1042646e-00ec-4817-939e-4b26c9f4a406', 'volume_name': 'volume-1042646e-00ec-4817-939e-4b26c9f4a406', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b698015-813c-4ed2-ad19-b80d4131d196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b698015-813c-4ed2-ad19-b80d4131d196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720d1cff-d70f-4ba3-870a-405bd4b3a515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:54 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Volume 1042646e-00ec-4817-939e-4b26c9f4a406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1042646e-00ec-4817-939e-4b26c9f4a406', 'volume_size': 1}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1444053136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1042646e-00ec-4817-939e-4b26c9f4a406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c121eeb43a8486e96819a6e7caacfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:55Z,use_quota=True,user_id='a90df285d7944a6388d861da8b5250b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Creating volume 1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:54 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:32:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:54 devstack sudo[105118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 1073741824
Sep 23 00:32:54 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:55 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 1073741824" returned: 0 in 0.532s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:55 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406
Sep 23 00:32:55 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:55 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.135s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating offline snapshot d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 of volume 46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720d1cff-d70f-4ba3-870a-405bd4b3a515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1042646e-00ec-4817-939e-4b26c9f4a406', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4870cd0-81e9-4acd-9ead-765461bba55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[137910a4-5988-4a2f-839c-4a3062ed85a7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:55 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Volume volume-1042646e-00ec-4817-939e-4b26c9f4a406 (1042646e-00ec-4817-939e-4b26c9f4a406): created successfully
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4870cd0-81e9-4acd-9ead-765461bba55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:55 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Flow 'volume_create_manager' (57e52f14-d5f2-45e2-9dbb-1f1d7aee60a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-209a58b7-40f7-4cfb-a25a-6856f4e7ef59 tempest-VolumeDependencyTests-968006145 None] Created volume successfully.
Sep 23 00:32:55 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae
Sep 23 00:32:55 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:56 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae" returned: 0 in 0.429s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:56 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 1G
Sep 23 00:32:56 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:56 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 1G" returned: 0 in 0.434s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fecd01-9835-443e-8ad6-7432d653b7ae -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:56 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fecd01-9835-443e-8ad6-7432d653b7ae -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7
Sep 23 00:32:56 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:56 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fecd01-9835-443e-8ad6-7432d653b7ae -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" returned: 0 in 0.378s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:56 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 is being set with open permissions: ugo+rw
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:56 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7
Sep 23 00:32:56 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:57 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" returned: 0 in 0.302s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:57 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info
Sep 23 00:32:57 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:57 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info" returned: 0 in 0.274s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:57 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info is being set with open permissions: ugo+rw
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:57 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info
Sep 23 00:32:57 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:57 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.info" returned: 0 in 0.269s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.834s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Creating offline snapshot 1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 of volume 1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:32:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-749aa734-1a8c-4d16-89fe-7c0364fda0d2 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Create snapshot completed successfully
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a1bdee-b5fa-4a29-ae0b-7b25a285aadb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:57 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406
Sep 23 00:32:57 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:58 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:58 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 1G
Sep 23 00:32:58 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:58 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 1G" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1042646e-00ec-4817-939e-4b26c9f4a406 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:58 devstack sudo[105166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1042646e-00ec-4817-939e-4b26c9f4a406 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1
Sep 23 00:32:58 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:59 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1042646e-00ec-4817-939e-4b26c9f4a406 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" returned: 0 in 0.380s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:59 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 is being set with open permissions: ugo+rw
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:59 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1
Sep 23 00:32:59 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (e1081700-24fb-4631-97cf-71b0839d1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4c666f-b767-4748-b72d-96f66e63055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4c666f-b767-4748-b72d-96f66e63055a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229326885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eac1ab6-ac83-47b2-a7d8-51d7777782d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:59Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b1d90e-98e3-43bf-9832-13ac30564592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b1d90e-98e3-43bf-9832-13ac30564592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0073d0-b1ff-479e-a61f-379d0c6e994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0073d0-b1ff-479e-a61f-379d0c6e994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eac1ab6-ac83-47b2-a7d8-51d7777782d5', 'volume_name': 'volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae6b099-e80c-43d0-a780-f00b1f5b6849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae6b099-e80c-43d0-a780-f00b1f5b6849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bff5db-1cf8-45c2-a67c-bb77633f4d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume 1eac1ab6-ac83-47b2-a7d8-51d7777782d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5', 'volume_size': 1}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:59 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" returned: 0 in 0.328s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:59 devstack sudo[105174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info
Sep 23 00:32:59 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (d2e0662d-f5f9-4ccc-8efd-0ee531f83678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2afeb8-8297-45e0-a787-cd8157f0e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info" returned: 0 in 0.337s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:59 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info is being set with open permissions: ugo+rw
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:59 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info
Sep 23 00:32:59 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2afeb8-8297-45e0-a787-cd8157f0e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460178923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f5a621-6848-4c17-9c8c-4a6289285a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:00Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47aa629-f15b-40ba-8c79-326b7437ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47aa629-f15b-40ba-8c79-326b7437ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47cab3ab-dd24-43fe-a1d9-47d6ede867d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47cab3ab-dd24-43fe-a1d9-47d6ede867d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f5a621-6848-4c17-9c8c-4a6289285a60', 'volume_name': 'volume-40f5a621-6848-4c17-9c8c-4a6289285a60', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13325e4a-c405-434a-a695-95947acb9f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13325e4a-c405-434a-a695-95947acb9f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dbb791-6653-4d35-b177-bdf0695b7848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume 40f5a621-6848-4c17-9c8c-4a6289285a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f5a621-6848-4c17-9c8c-4a6289285a60', 'volume_size': 1}
Sep 23 00:32:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:00 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.info" returned: 0 in 0.320s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229326885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eac1ab6-ac83-47b2-a7d8-51d7777782d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:59Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating volume 1eac1ab6-ac83-47b2-a7d8-51d7777782d5 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:00 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:00 devstack sudo[105180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 1073741824
Sep 23 00:33:00 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b8837099-c510-414e-9add-2814d3a99d54 tempest-VolumeDependencyTests-968006145 None] Create snapshot completed successfully
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (93bd745e-c7e3-4b3e-8610-51eae9e46215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7f8b70-0e19-48d1-8b7e-6976e2089ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7f8b70-0e19-48d1-8b7e-6976e2089ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198536461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485ec99a-8033-497a-84d5-82051067c407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:00Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413db0c9-cfc5-4fca-9377-93e6ef0b6da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413db0c9-cfc5-4fca-9377-93e6ef0b6da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c57708-bad0-4432-9ce6-3340f4707751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c57708-bad0-4432-9ce6-3340f4707751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485ec99a-8033-497a-84d5-82051067c407', 'volume_name': 'volume-485ec99a-8033-497a-84d5-82051067c407', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9dbef0-cf14-427b-a902-6e3cef2cbf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9dbef0-cf14-427b-a902-6e3cef2cbf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7387ea75-bd7d-435c-b270-ee310984c75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume 485ec99a-8033-497a-84d5-82051067c407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485ec99a-8033-497a-84d5-82051067c407', 'volume_size': 1}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (255596db-4bda-4d6e-a067-0207ac75c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf0dd92-3f8e-444d-b4b9-579c3bc3c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf0dd92-3f8e-444d-b4b9-579c3bc3c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-48069463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba9f57a-eea5-4e80-b6c3-a36a259973ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:01Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72094163-9c56-4e38-90a6-b33eb044e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72094163-9c56-4e38-90a6-b33eb044e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ec55d9-158d-4949-a6f9-1c8a96bd7135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ec55d9-158d-4949-a6f9-1c8a96bd7135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba9f57a-eea5-4e80-b6c3-a36a259973ca', 'volume_name': 'volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be382b80-6948-4c8d-8ad1-4c0bfa41aa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be382b80-6948-4c8d-8ad1-4c0bfa41aa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647dbbe9-4a2e-4c0c-ad5f-b5b862f29e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume 1ba9f57a-eea5-4e80-b6c3-a36a259973ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca', 'volume_size': 1}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 1073741824" returned: 0 in 0.608s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:00 devstack sudo[105186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5
Sep 23 00:33:00 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:01 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5" returned: 0 in 0.323s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.260s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460178923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f5a621-6848-4c17-9c8c-4a6289285a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:00Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating volume 40f5a621-6848-4c17-9c8c-4a6289285a60 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:01 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:01 devstack sudo[105189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60 1073741824
Sep 23 00:33:01 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bff5db-1cf8-45c2-a67c-bb77633f4d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a021de5-9959-4f30-aad7-7755c0bc72bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:01 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 (1eac1ab6-ac83-47b2-a7d8-51d7777782d5): created successfully
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a021de5-9959-4f30-aad7-7755c0bc72bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (e1081700-24fb-4631-97cf-71b0839d1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (1b61e0c5-4210-458f-b0e7-85f5493f9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0936f7-d254-4754-89e1-b10178779c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0936f7-d254-4754-89e1-b10178779c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461811772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682bc536-5f73-434d-9112-bb5c9ed64e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:01Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0dcd2b-7667-49ff-9b6d-c030f053d72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0dcd2b-7667-49ff-9b6d-c030f053d72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f4bcdc-f2c8-4b64-9f82-7a7357b0eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f4bcdc-f2c8-4b64-9f82-7a7357b0eb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682bc536-5f73-434d-9112-bb5c9ed64e60', 'volume_name': 'volume-682bc536-5f73-434d-9112-bb5c9ed64e60', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f289528-ff53-475d-bdda-5ebce0a46ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f289528-ff53-475d-bdda-5ebce0a46ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a76436a-8e89-40cf-b5d5-6f4ec0e54fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:01 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume 682bc536-5f73-434d-9112-bb5c9ed64e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682bc536-5f73-434d-9112-bb5c9ed64e60', 'volume_size': 1}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-abdd5eef-0635-4e37-a21d-5f1a8970ae75 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created volume successfully.
Sep 23 00:33:01 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60 1073741824" returned: 0 in 0.500s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:01 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60
Sep 23 00:33:01 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Flow 'volume_create_manager' (974859e5-bc36-48b9-83f9-752e615f9318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ea6ff1-8340-4a2e-9a3f-7056ecc84149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ea6ff1-8340-4a2e-9a3f-7056ecc84149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1833275107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc62b94-fe63-4ea3-9614-dbefe52dd580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c121eeb43a8486e96819a6e7caacfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b92af13-af1e-4e4b-9e89-e4a7008f4ed1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:02Z,use_quota=True,user_id='a90df285d7944a6388d861da8b5250b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0fea97-9290-4458-9480-11ec076bc08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0fea97-9290-4458-9480-11ec076bc08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b089cfaa-6c14-4254-88c9-c65066df56ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b089cfaa-6c14-4254-88c9-c65066df56ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6bc62b94-fe63-4ea3-9614-dbefe52dd580', 'volume_name': 'volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580', 'volume_size': 1, 'snapshot_id': '1b92af13-af1e-4e4b-9e89-e4a7008f4ed1'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f11e80-4222-45a3-8e5a-069d369ae911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f11e80-4222-45a3-8e5a-069d369ae911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae54386-d32e-4066-9585-35262fb70b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Volume 6bc62b94-fe63-4ea3-9614-dbefe52dd580: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580', 'volume_size': 1, 'snapshot_id': '1b92af13-af1e-4e4b-9e89-e4a7008f4ed1'}
Sep 23 00:33:02 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60" returned: 0 in 0.331s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198536461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485ec99a-8033-497a-84d5-82051067c407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:00Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating volume 485ec99a-8033-497a-84d5-82051067c407 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dbb791-6653-4d35-b177-bdf0695b7848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f5a621-6848-4c17-9c8c-4a6289285a60', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407 1073741824
Sep 23 00:33:02 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852787a1-fd75-4f4e-93da-b6b56c918793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume volume-40f5a621-6848-4c17-9c8c-4a6289285a60 (40f5a621-6848-4c17-9c8c-4a6289285a60): created successfully
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852787a1-fd75-4f4e-93da-b6b56c918793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (d2e0662d-f5f9-4ccc-8efd-0ee531f83678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9aded2c4-6042-4144-af77-1693622c98fb tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created volume successfully.
Sep 23 00:33:02 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407 1073741824" returned: 0 in 0.460s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:02 devstack sudo[105205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407
Sep 23 00:33:02 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:02 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407" returned: 0 in 0.251s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-48069463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba9f57a-eea5-4e80-b6c3-a36a259973ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:01Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating volume 1ba9f57a-eea5-4e80-b6c3-a36a259973ca {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7387ea75-bd7d-435c-b270-ee310984c75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485ec99a-8033-497a-84d5-82051067c407', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca 1073741824
Sep 23 00:33:02 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2266b62-3f2f-4126-90a5-210b6c1dda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume volume-485ec99a-8033-497a-84d5-82051067c407 (485ec99a-8033-497a-84d5-82051067c407): created successfully
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2266b62-3f2f-4126-90a5-210b6c1dda4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (93bd745e-c7e3-4b3e-8610-51eae9e46215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-206ffd95-b72e-49b1-9408-76087f27ed29 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created volume successfully.
Sep 23 00:33:03 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca 1073741824" returned: 0 in 0.431s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:03 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca
Sep 23 00:33:03 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:03 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca" returned: 0 in 0.243s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.196s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461811772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682bc536-5f73-434d-9112-bb5c9ed64e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32745ed7c0194c3aaee30bbe78b295e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:01Z,use_quota=True,user_id='1bf57b5292434187995033f09cd4a7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Creating volume 682bc536-5f73-434d-9112-bb5c9ed64e60 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:03 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:03 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60 1073741824
Sep 23 00:33:03 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647dbbe9-4a2e-4c0c-ad5f-b5b862f29e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53454130-d4b4-4d8d-8d1e-9b686bdf5b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:03 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca (1ba9f57a-eea5-4e80-b6c3-a36a259973ca): created successfully
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53454130-d4b4-4d8d-8d1e-9b686bdf5b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (255596db-4bda-4d6e-a067-0207ac75c66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-02df825a-cc3f-4ae8-b472-b51e21c8c7b0 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created volume successfully.
Sep 23 00:33:04 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60 1073741824" returned: 0 in 0.492s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:04 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60
Sep 23 00:33:04 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:04 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60" returned: 0 in 0.258s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.313s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-quobyte-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1-6bc62b94-fe63-4ea3-9614-dbefe52dd580" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a76436a-8e89-40cf-b5d5-6f4ec0e54fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682bc536-5f73-434d-9112-bb5c9ed64e60', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bb7002-f0b0-4aa4-b238-876d0f3223f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1-6bc62b94-fe63-4ea3-9614-dbefe52dd580" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Creating volume 6bc62b94-fe63-4ea3-9614-dbefe52dd580 from snapshot 1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-quobyte-6bc62b94-fe63-4ea3-9614-dbefe52dd580" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:04 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Volume volume-682bc536-5f73-434d-9112-bb5c9ed64e60 (682bc536-5f73-434d-9112-bb5c9ed64e60): created successfully
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bb7002-f0b0-4aa4-b238-876d0f3223f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Flow 'volume_create_manager' (1b61e0c5-4210-458f-b0e7-85f5493f9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-6bc62b94-fe63-4ea3-9614-dbefe52dd580" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] snapshot: 1b92af13-af1e-4e4b-9e89-e4a7008f4ed1, volume: 6bc62b94-fe63-4ea3-9614-dbefe52dd580,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:33:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2c562c0b-d1bc-46c6-a842-c848d6112185 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created volume successfully.
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[79798054-3cc7-49a4-a2b7-8bb521265e99]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-682bc536-5f73-434d-9112-bb5c9ed64e60-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-682bc536-5f73-434d-9112-bb5c9ed64e60-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:04 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1
Sep 23 00:33:04 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-682bc536-5f73-434d-9112-bb5c9ed64e60" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-682bc536-5f73-434d-9112-bb5c9ed64e60" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad3f8e5-2a33-4966-9e1e-352f809860f4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:04 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60
Sep 23 00:33:04 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:05 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1042646e-00ec-4817-939e-4b26c9f4a406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[035c3753-d0c7-413e-a39a-22d849fd0116]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:05 devstack sudo[105231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406
Sep 23 00:33:05 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:05 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60" returned: 0 in 0.428s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:05 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60
Sep 23 00:33:05 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:05 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406" returned: 0 in 0.413s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:33:05 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-682bc536-5f73-434d-9112-bb5c9ed64e60" returned: 0 in 0.276s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:05 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-682bc536-5f73-434d-9112-bb5c9ed64e60" released by "delete_volume" :: held 0.754s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:05 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['077e9324-29e0-4c5e-99ce-7891303a4f2c', 'be70b71e-f5cb-4bea-905d-606959f7b755', '4a5fc4df-da49-4986-b973-51d6100c6b6c', '31a3fdbc-20aa-40c4-8fc9-091c93ccdb33', 'b90b80d9-a3cf-44c2-8cff-a203d2d8e016'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:05 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:05 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-1ba9f57a-eea5-4e80-b6c3-a36a259973ca-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-1ba9f57a-eea5-4e80-b6c3-a36a259973ca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:05 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.293s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleted volume successfully.
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-1ba9f57a-eea5-4e80-b6c3-a36a259973ca" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c310e9e3-37ec-4250-9e14-1f3e90f1724f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-682bc536-5f73-434d-9112-bb5c9ed64e60-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-1ba9f57a-eea5-4e80-b6c3-a36a259973ca" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0258f-845b-44dc-a9c5-66fb0d14ad6b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:06 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca
Sep 23 00:33:06 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:06 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca" returned: 0 in 0.604s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:06 devstack sudo[105264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca
Sep 23 00:33:06 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:07 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1ba9f57a-eea5-4e80-b6c3-a36a259973ca" returned: 0 in 0.668s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-1ba9f57a-eea5-4e80-b6c3-a36a259973ca" released by "delete_volume" :: held 1.338s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['5eb70b12-003f-4bde-965d-5f8c235be91e', 'a598c4f2-7f20-47ad-aa25-60f3bb636726', '4ada9fe7-833d-48c7-bb76-1e38fc27437b', 'bde993e0-8080-46e0-b389-e53587d7dbed', '52e4c460-6efd-4192-98f3-36e49063c25b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:07 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:07 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:08 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.556s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleted volume successfully.
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-87640631-9aba-4a9e-b64f-53d1fefb568a tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-1ba9f57a-eea5-4e80-b6c3-a36a259973ca-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-485ec99a-8033-497a-84d5-82051067c407-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-485ec99a-8033-497a-84d5-82051067c407-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-485ec99a-8033-497a-84d5-82051067c407" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-485ec99a-8033-497a-84d5-82051067c407" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65b28a6-e0ff-4b49-af88-c97d8274f73c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:08 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407
Sep 23 00:33:08 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:09 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407" returned: 0 in 0.637s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:09 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407
Sep 23 00:33:09 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:09 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-485ec99a-8033-497a-84d5-82051067c407" returned: 0 in 0.376s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-485ec99a-8033-497a-84d5-82051067c407" released by "delete_volume" :: held 1.106s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['9edd12ab-1d64-4d34-9276-bf0c06c15fef', '28583b43-2c6f-4d47-9d86-d17d23cd64b6', '2c5ba0a5-211f-4623-aa00-e7362fa70894', '24109327-0180-4d88-9165-a84e11d4603a', '09418f97-f7a8-4ae5-a868-00efc33d67d8'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:09 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:09 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:10 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.374s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:10 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleted volume successfully.
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f7a64d1-d5f6-4b15-b9c6-66072c182109 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-485ec99a-8033-497a-84d5-82051067c407-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-40f5a621-6848-4c17-9c8c-4a6289285a60-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-40f5a621-6848-4c17-9c8c-4a6289285a60-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=109,cinder:UPDATE=158,cinder:INSERT=44,cinder:DELETE=14 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:33:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-40f5a621-6848-4c17-9c8c-4a6289285a60" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-40f5a621-6848-4c17-9c8c-4a6289285a60" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79cd7a0-bb51-4ff1-9348-21f0e7f7b6cb]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:11 devstack sudo[105281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60
Sep 23 00:33:11 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:11 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60" returned: 0 in 0.633s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:11 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60
Sep 23 00:33:11 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-40f5a621-6848-4c17-9c8c-4a6289285a60" returned: 0 in 0.437s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-40f5a621-6848-4c17-9c8c-4a6289285a60" released by "delete_volume" :: held 1.151s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=137,cinder:UPDATE=146,cinder:INSERT=41,cinder:DELETE=12 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['576b8815-57f5-4fe8-b7e5-5067887bea6b', '5f780592-9acf-4834-aef2-f1a0cc75ac82', 'd13bf15e-5ab4-4f71-8d3f-22ef38b7aafb', 'b221671c-81c1-449d-bdfc-62e848a56626', '9ed9c522-7523-4e7d-b4e9-1ee6c49eb3cc'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:12 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580" returned: 0 in 6.883s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:33:12 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Converted 1024.00 MB image at 148.74 MB/s
Sep 23 00:33:12 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 is being set with open permissions: ugo+rw
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580
Sep 23 00:33:12 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:12 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580" returned: 0 in 0.318s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-6bc62b94-fe63-4ea3-9614-dbefe52dd580" released by "_copy_volume_from_snapshot" :: held 8.200s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1-6bc62b94-fe63-4ea3-9614-dbefe52dd580" released by "_create_volume_from_snapshot" :: held 8.304s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.340s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:12 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.338s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae54386-d32e-4066-9585-35262fb70b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580', 'volume_size': 1, 'snapshot_id': '1b92af13-af1e-4e4b-9e89-e4a7008f4ed1'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b87b6b6-f009-47ba-883b-cee4200a3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleted volume successfully.
Sep 23 00:33:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Volume volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 (6bc62b94-fe63-4ea3-9614-dbefe52dd580): created successfully
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b87b6b6-f009-47ba-883b-cee4200a3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Flow 'volume_create_manager' (974859e5-bc36-48b9-83f9-752e615f9318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ffeb9d1c-f579-4ff5-bd13-ab0a000b2585 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-40f5a621-6848-4c17-9c8c-4a6289285a60-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:12 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9b56a604-3334-43b0-8e52-1cbb1aff16b0 tempest-VolumeDependencyTests-968006145 None] Created volume successfully.
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-1eac1ab6-ac83-47b2-a7d8-51d7777782d5-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-1eac1ab6-ac83-47b2-a7d8-51d7777782d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-1eac1ab6-ac83-47b2-a7d8-51d7777782d5" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-1eac1ab6-ac83-47b2-a7d8-51d7777782d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4068c9-d170-4482-b7a1-17c22ca9be97]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:13 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5
Sep 23 00:33:13 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:13 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5" returned: 0 in 0.445s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5
Sep 23 00:33:13 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Lock "cinder-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-quobyte-1042646e-00ec-4817-939e-4b26c9f4a406" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1042646e-00ec-4817-939e-4b26c9f4a406" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-quobyte-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Deleting offline snapshot 1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 of volume 1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] snapshot_file for this snap is: volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec235601-b28e-40f9-9cea-1a5d71fed67c]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1
Sep 23 00:33:14 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1eac1ab6-ac83-47b2-a7d8-51d7777782d5" returned: 0 in 0.322s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-1eac1ab6-ac83-47b2-a7d8-51d7777782d5" released by "delete_volume" :: held 0.819s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['112013b8-a77a-4f85-8361-e832d75a331b', 'd2a39c92-3506-47e8-a70c-f0f5898dba46', 'a2574db0-a123-4c6b-8424-4ecbd3f1aaea', 'c1f21206-19d9-445c-9c02-0fe75d526e67', 'bf449f82-e45b-4e34-8409-0a26947d8954'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack sudo[105316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:14 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" returned: 0 in 0.426s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1042646e-00ec-4817-939e-4b26c9f4a406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec283726-6055-4eec-9477-9f7bee45f7dd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-d88fe7e7-d54a-4a01-bc3f-9e820a095eb7-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-d88fe7e7-d54a-4a01-bc3f-9e820a095eb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-46fecd01-9835-443e-8ad6-7432d653b7ae" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-46fecd01-9835-443e-8ad6-7432d653b7ae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleting offline snapshot d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 of volume 46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] snapshot_file for this snap is: volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[84470b4b-8753-4cbf-b7fa-74eb681f1740]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406
Sep 23 00:33:14 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.353s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:14 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7
Sep 23 00:33:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleted volume successfully.
Sep 23 00:33:14 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-70262144-f960-4e68-93c7-3029df1fbec8 tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-1eac1ab6-ac83-47b2-a7d8-51d7777782d5-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:15 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" returned: 0 in 0.439s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46fecd01-9835-443e-8ad6-7432d653b7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e02d0d-5af3-4c4f-873b-34b446c3163a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406" returned: 0 in 0.642s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1
Sep 23 00:33:15 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae
Sep 23 00:33:15 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1
Sep 23 00:33:15 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae" returned: 0 in 0.414s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[105341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7
Sep 23 00:33:15 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406.1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" returned: 0 in 0.272s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1" released by "_delete_snapshot" :: held 1.828s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1042646e-00ec-4817-939e-4b26c9f4a406" released by "delete_snapshot" :: held 1.855s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Created reservations ['399b93c0-7860-4fb4-9085-cbd6658e9170', '65e64882-dbc5-4aba-8777-54db5496ab72', 'fa1790f5-44b5-4d69-a002-7719dc64a133', '3bde6fec-cbe8-4407-bcf8-2a54408bfcc5', 'e0a8bb44-63e0-494c-8630-c9965be6da6a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:15 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" returned: 0 in 0.386s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[105347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7
Sep 23 00:33:15 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Delete snapshot completed successfully.
Sep 23 00:33:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-46b0fc3c-6fcf-4ad9-954a-9e71c27471cd tempest-VolumeDependencyTests-968006145 None] Lock "cinder-1b92af13-af1e-4e4b-9e89-e4a7008f4ed1-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-1042646e-00ec-4817-939e-4b26c9f4a406-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-1042646e-00ec-4817-939e-4b26c9f4a406-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-quobyte-1042646e-00ec-4817-939e-4b26c9f4a406" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1042646e-00ec-4817-939e-4b26c9f4a406" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:16 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae.d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" returned: 0 in 0.309s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd90a55-5408-4986-8999-ed7e40845c38]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-d88fe7e7-d54a-4a01-bc3f-9e820a095eb7" released by "_delete_snapshot" :: held 1.669s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-46fecd01-9835-443e-8ad6-7432d653b7ae" released by "delete_snapshot" :: held 1.696s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['4ba70c73-d03e-4116-a0fa-0ef20de5010b', '5f39b1f7-3881-4d88-bbed-7389ea106685', '3fda10f3-169a-4a54-8a20-d166de68fb2d', '983bd272-b6ee-4f49-a6d0-5156ffd4291c', 'a1c4bc9a-0888-4f12-8126-5f9f65d42357'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:16 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406
Sep 23 00:33:16 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Delete snapshot completed successfully.
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-43f443f1-7655-4e43-898d-7711222a721f tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-d88fe7e7-d54a-4a01-bc3f-9e820a095eb7-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:16 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:16 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406
Sep 23 00:33:16 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-46fecd01-9835-443e-8ad6-7432d653b7ae-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-46fecd01-9835-443e-8ad6-7432d653b7ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "cinder-quobyte-46fecd01-9835-443e-8ad6-7432d653b7ae" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-46fecd01-9835-443e-8ad6-7432d653b7ae" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a484b-aea1-434e-9a62-e98be5683ae7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:16 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1042646e-00ec-4817-939e-4b26c9f4a406" returned: 0 in 0.298s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-1042646e-00ec-4817-939e-4b26c9f4a406" released by "delete_volume" :: held 0.785s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:16 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae
Sep 23 00:33:16 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Created reservations ['2f8fc1f0-1707-4cc5-abaa-55d5f00a48cf', 'a708a72a-d870-4366-b0ac-821b808b1ed2', '3815551b-0ca3-4b90-85b6-24499fa96a53', '384beb28-83eb-4a2c-a480-8cf3bdf2384e', '48a95325-5afd-4081-b98d-2618f1579534'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:17 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:17 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-6bc62b94-fe63-4ea3-9614-dbefe52dd580-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:17 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae" returned: 0 in 0.533s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Lock "cinder-6bc62b94-fe63-4ea3-9614-dbefe52dd580-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:17 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae
Sep 23 00:33:17 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Acquiring lock "cinder-quobyte-6bc62b94-fe63-4ea3-9614-dbefe52dd580" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-6bc62b94-fe63-4ea3-9614-dbefe52dd580" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:17 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b223a-2a7f-4bcd-ba0f-f8c8abc10252]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.378s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Deleted volume successfully.
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-07947512-b756-419d-848c-a2c153bfe2b1 tempest-VolumeDependencyTests-968006145 None] Lock "cinder-1042646e-00ec-4817-939e-4b26c9f4a406-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:17 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580
Sep 23 00:33:17 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:17 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-46fecd01-9835-443e-8ad6-7432d653b7ae" returned: 0 in 0.343s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-quobyte-46fecd01-9835-443e-8ad6-7432d653b7ae" released by "delete_volume" :: held 0.955s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Created reservations ['22d25cce-fb1a-4330-b58c-0ad7c9be792f', '7113f8fd-d66a-4128-baa9-208e4e18a0cb', '8859b1c7-f20c-4df5-b95c-6784a4377ef6', 'ce1cb44a-56ed-4656-8266-2d1d49ad6442', 'eea91d00-c7ae-4c39-b890-77b096a58070'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:17 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:17 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:18 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:18 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580
Sep 23 00:33:18 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:18 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.295s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Deleted volume successfully.
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b8d8f0f3-05c8-4cf7-9850-b33e35ee3b5e tempest-CreateVolumesFromSnapshotTest-1427990844 None] Lock "cinder-46fecd01-9835-443e-8ad6-7432d653b7ae-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:18 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6bc62b94-fe63-4ea3-9614-dbefe52dd580" returned: 0 in 0.313s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Lock "cinder-quobyte-6bc62b94-fe63-4ea3-9614-dbefe52dd580" released by "delete_volume" :: held 0.901s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Created reservations ['971a979a-7c91-45ab-b49c-1f94c37d1997', '3289cf1a-eb48-47a0-8a3d-d2f73d113585', '2943055a-ce35-47d2-a13d-3784d69edb7f', '2d9028a8-4cad-4a42-b248-35f0ebf872e0', 'ecbcda67-3e96-41f8-af01-0bb33baa7ce6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:18 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:18 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:18 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.248s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Deleted volume successfully.
Sep 23 00:33:18 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-018e8bbc-561b-4f03-a771-eb419f55244a tempest-VolumeDependencyTests-968006145 None] Lock "cinder-6bc62b94-fe63-4ea3-9614-dbefe52dd580-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Flow 'volume_create_manager' (46ef2a30-64d0-4327-aa5d-13c8e7c54c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabcffaa-d07f-455b-af78-1c502d7b4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabcffaa-d07f-455b-af78-1c502d7b4310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b47589a-8ae3-4774-8ac9-a456c9fc9507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd7dd85d4e74f93a1d802afe5195b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:26Z,use_quota=True,user_id='b92156669434487d8306f35d37cbca08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2812a9-c261-490a-9e26-196e47551abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2812a9-c261-490a-9e26-196e47551abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bc7756-2c70-4fc3-aa3a-8a7e84107e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bc7756-2c70-4fc3-aa3a-8a7e84107e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b47589a-8ae3-4774-8ac9-a456c9fc9507', 'volume_name': 'volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507', 'volume_size': 1, 'image_id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb28b00d-1b88-4930-b187-2c944e2b48c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '666b77b94c46bee22fa9c5ccfa481aca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bd7dd85d4e74f93a1d802afe5195b08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9adbf7e0ed7d3f6c70ab092643ae31999b42c09428d2db13798882bbf1988def9e2e7a2192d00a7837869c444dbdba17a603429cf8a98ef806afb18c604390f2', 'id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb28b00d-1b88-4930-b187-2c944e2b48c9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4cdae70>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081d139d-15cc-4a0e-8251-4e8b2b6b72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081d139d-15cc-4a0e-8251-4e8b2b6b72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e030ed-98b5-4bdf-9775-d367968e2abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:26 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Volume 5b47589a-8ae3-4774-8ac9-a456c9fc9507: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507', 'volume_size': 1, 'image_id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb28b00d-1b88-4930-b187-2c944e2b48c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '666b77b94c46bee22fa9c5ccfa481aca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bd7dd85d4e74f93a1d802afe5195b08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9adbf7e0ed7d3f6c70ab092643ae31999b42c09428d2db13798882bbf1988def9e2e7a2192d00a7837869c444dbdba17a603429cf8a98ef806afb18c604390f2', 'id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb28b00d-1b88-4930-b187-2c944e2b48c9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4cdae70>}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Trying to clone 5b47589a-8ae3-4774-8ac9-a456c9fc9507 from image fb28b00d-1b88-4930-b187-2c944e2b48c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb28b00d-1b88-4930-b187-2c944e2b48c9', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:33:26 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1db61-9fd9-4d0a-a468-6f4202d57588]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:26 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD
Sep 23 00:33:26 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:27 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD
Sep 23 00:33:27 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Temporary image fb28b00d-1b88-4930-b187-2c944e2b48c9 is fetched for user b92156669434487d8306f35d37cbca08. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[98305426-55f0-44d4-9153-8cd4d4543cb6]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:27 devstack sudo[105394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD
Sep 23 00:33:27 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:28 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD
Sep 23 00:33:28 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:28 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b47589a-8ae3-4774-8ac9-a456c9fc9507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd7dd85d4e74f93a1d802afe5195b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:26Z,use_quota=True,user_id='b92156669434487d8306f35d37cbca08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Creating volume 5b47589a-8ae3-4774-8ac9-a456c9fc9507 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:28 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:28 devstack sudo[105403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 1073741824
Sep 23 00:33:28 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:28 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 1073741824" returned: 0 in 0.534s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:28 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507
Sep 23 00:33:28 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:29 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507" returned: 0 in 0.290s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Attempting download of fb28b00d-1b88-4930-b187-2c944e2b48c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb28b00d-1b88-4930-b187-2c944e2b48c9', 'metadata': {}}])) to volume 5b47589a-8ae3-4774-8ac9-a456c9fc9507. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d9d02-06c4-409d-ad3c-fff4252cdf30]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:29 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t
Sep 23 00:33:29 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:29 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t" returned: 0 in 0.387s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:29 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t
Sep 23 00:33:29 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:30 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t" returned: 1 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb28b00d-1b88-4930-b187-2c944e2b48c9_wq907g5t' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf79278-79e9-48da-b21d-0564345d7300]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:30 devstack sudo[105420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD
Sep 23 00:33:30 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:30 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:30 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD
Sep 23 00:33:30 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:30 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] fb28b00d-1b88-4930-b187-2c944e2b48c9 was raw, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:33:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:30 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507
Sep 23 00:33:30 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:31 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507" returned: 0 in 0.578s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb28b00d-1b88-4930-b187-2c944e2b48c9_m4r_rfindevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:33:31 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:31 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 1G
Sep 23 00:33:31 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:31 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 1G" returned: 0 in 0.440s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Downloaded image fb28b00d-1b88-4930-b187-2c944e2b48c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb28b00d-1b88-4930-b187-2c944e2b48c9', 'metadata': {}}])) to volume 5b47589a-8ae3-4774-8ac9-a456c9fc9507 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Temporary image fb28b00d-1b88-4930-b187-2c944e2b48c9 for user b92156669434487d8306f35d37cbca08 is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Marking volume 5b47589a-8ae3-4774-8ac9-a456c9fc9507 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Copying metadata from image fb28b00d-1b88-4930-b187-2c944e2b48c9 to 5b47589a-8ae3-4774-8ac9-a456c9fc9507. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:33:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Creating volume glance metadata for volume 5b47589a-8ae3-4774-8ac9-a456c9fc9507 backed by image fb28b00d-1b88-4930-b187-2c944e2b48c9 with: {'image_id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '666b77b94c46bee22fa9c5ccfa481aca', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e030ed-98b5-4bdf-9775-d367968e2abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507', 'volume_size': 1, 'image_id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb28b00d-1b88-4930-b187-2c944e2b48c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '666b77b94c46bee22fa9c5ccfa481aca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bd7dd85d4e74f93a1d802afe5195b08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9adbf7e0ed7d3f6c70ab092643ae31999b42c09428d2db13798882bbf1988def9e2e7a2192d00a7837869c444dbdba17a603429cf8a98ef806afb18c604390f2', 'id': 'fb28b00d-1b88-4930-b187-2c944e2b48c9', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb28b00d-1b88-4930-b187-2c944e2b48c9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4cdae70>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b6048d-50f7-4495-bdc1-ec1df80f6bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Volume volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 (5b47589a-8ae3-4774-8ac9-a456c9fc9507): created successfully
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b6048d-50f7-4495-bdc1-ec1df80f6bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Flow 'volume_create_manager' (46ef2a30-64d0-4327-aa5d-13c8e7c54c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:32 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c9558282-8fbd-431d-b659-6bb4714f5304 tempest-VolumeImageDependencyTests-79714201 None] Created volume successfully.
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Acquiring lock "cinder-5b47589a-8ae3-4774-8ac9-a456c9fc9507-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Lock "cinder-5b47589a-8ae3-4774-8ac9-a456c9fc9507-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Acquiring lock "cinder-quobyte-5b47589a-8ae3-4774-8ac9-a456c9fc9507" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Lock "cinder-quobyte-5b47589a-8ae3-4774-8ac9-a456c9fc9507" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372bbcc-2f79-4bfc-8a13-e72711f6ca57]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:32 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507
Sep 23 00:33:32 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:33 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507" returned: 0 in 0.440s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:33 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507
Sep 23 00:33:33 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:33 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-5b47589a-8ae3-4774-8ac9-a456c9fc9507" returned: 0 in 0.281s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Lock "cinder-quobyte-5b47589a-8ae3-4774-8ac9-a456c9fc9507" released by "delete_volume" :: held 0.774s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Created reservations ['8ea71c13-219f-4957-8e8c-876accd9d282', '7e1446cb-e5bf-4d4b-ab40-c187ae7e416a', '7c46e456-8cf1-4ee2-9263-221fc6e90a88', 'fd15f65c-e080-4784-8765-0e4e182825dd', '6b44b1cd-116f-485a-b08b-6ddf3c95ce5d'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:33 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:33 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:33 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.358s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:33 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Deleted volume successfully.
Sep 23 00:33:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-73fc4c3f-3032-40da-a30d-94098c950d7c tempest-VolumeImageDependencyTests-79714201 None] Lock "cinder-5b47589a-8ae3-4774-8ac9-a456c9fc9507-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (d56ea816-5700-4752-9f50-3e1fbe502109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5bece3-70fe-42a4-9498-d171af6bea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5bece3-70fe-42a4-9498-d171af6bea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886714582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8116c1ef-46d8-4e77-8977-1b1fb896ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:38Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196e4828-cf55-44c0-8404-6aa11dacdf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196e4828-cf55-44c0-8404-6aa11dacdf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b76f26d-1c57-43fe-91e2-a4364f5d8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b76f26d-1c57-43fe-91e2-a4364f5d8563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8116c1ef-46d8-4e77-8977-1b1fb896ec3d', 'volume_name': 'volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da57be20-1988-4305-af8f-32fd9a55f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da57be20-1988-4305-af8f-32fd9a55f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654aca48-e1c3-4ab7-9fff-f91f6ad40f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Volume 8116c1ef-46d8-4e77-8977-1b1fb896ec3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d', 'volume_size': 1}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886714582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8116c1ef-46d8-4e77-8977-1b1fb896ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:38Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Creating volume 8116c1ef-46d8-4e77-8977-1b1fb896ec3d {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:38 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:38 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d 1073741824
Sep 23 00:33:38 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:39 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d 1073741824" returned: 0 in 0.552s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:39 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d
Sep 23 00:33:39 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:39 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d" returned: 0 in 0.332s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654aca48-e1c3-4ab7-9fff-f91f6ad40f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fefd721-b990-48b9-946c-4375894c8ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Volume volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d (8116c1ef-46d8-4e77-8977-1b1fb896ec3d): created successfully
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fefd721-b990-48b9-946c-4375894c8ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (d56ea816-5700-4752-9f50-3e1fbe502109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-aeb73e40-e8db-4560-b524-54074165a599 tempest-ProjectReaderTests-454418082 None] Created volume successfully.
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:40 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:40 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:40 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.278s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-8116c1ef-46d8-4e77-8977-1b1fb896ec3d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Lock "cinder-8116c1ef-46d8-4e77-8977-1b1fb896ec3d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-quobyte-8116c1ef-46d8-4e77-8977-1b1fb896ec3d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-8116c1ef-46d8-4e77-8977-1b1fb896ec3d" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1251232f-a4dc-408a-a82a-1f3811f493dc]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:40 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d
Sep 23 00:33:40 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:41 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d" returned: 0 in 0.379s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:41 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d
Sep 23 00:33:41 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:41 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-8116c1ef-46d8-4e77-8977-1b1fb896ec3d" returned: 0 in 0.258s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-8116c1ef-46d8-4e77-8977-1b1fb896ec3d" released by "delete_volume" :: held 0.684s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Created reservations ['d5ce58ff-823c-4614-87de-98e2061e3dd4', '43fb8a2b-0c5d-4ccc-b96d-641979c790f3', '374caae7-742e-489a-93d4-2e833a13b447', '2dbb33ca-b089-45bd-abb6-9d02452f3793', '99923b0d-098c-4e2f-a7f0-0ac568466e53'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:41 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:41 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:41 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.292s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Deleted volume successfully.
Sep 23 00:33:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-98ce68f1-2189-4e66-8dcd-2262000d240e tempest-ProjectReaderTests-454418082 None] Lock "cinder-8116c1ef-46d8-4e77-8977-1b1fb896ec3d-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (9440b012-1b80-44a4-a380-54daced06526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b9c1f1-dc71-46cf-b25f-a414480d5c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b9c1f1-dc71-46cf-b25f-a414480d5c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1458082820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85200acc-7db3-453c-a851-edc9d840ea59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:42Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79219c6a-51ef-47b4-9377-41a24cf21bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79219c6a-51ef-47b4-9377-41a24cf21bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e00c75f-36a3-414d-859a-283fae261e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e00c75f-36a3-414d-859a-283fae261e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85200acc-7db3-453c-a851-edc9d840ea59', 'volume_name': 'volume-85200acc-7db3-453c-a851-edc9d840ea59', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2867f53a-8214-452e-9491-60c3af201afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2867f53a-8214-452e-9491-60c3af201afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a135a9-7e02-43b5-abeb-58d385102932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Volume 85200acc-7db3-453c-a851-edc9d840ea59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85200acc-7db3-453c-a851-edc9d840ea59', 'volume_size': 1}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1458082820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85200acc-7db3-453c-a851-edc9d840ea59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:42Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Creating volume 85200acc-7db3-453c-a851-edc9d840ea59 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:42 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:42 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59 1073741824
Sep 23 00:33:42 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:43 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59 1073741824" returned: 0 in 0.479s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:43 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59
Sep 23 00:33:43 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:43 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59" returned: 0 in 0.278s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a135a9-7e02-43b5-abeb-58d385102932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85200acc-7db3-453c-a851-edc9d840ea59', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247ffece-686d-4f7e-8a87-0e57ca145d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Volume volume-85200acc-7db3-453c-a851-edc9d840ea59 (85200acc-7db3-453c-a851-edc9d840ea59): created successfully
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247ffece-686d-4f7e-8a87-0e57ca145d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (9440b012-1b80-44a4-a380-54daced06526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-48b9a6aa-801a-4ffa-b955-2e87306d24ec tempest-ProjectReaderTests-454418082 None] Created volume successfully.
Sep 23 00:33:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-85200acc-7db3-453c-a851-edc9d840ea59-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Lock "cinder-85200acc-7db3-453c-a851-edc9d840ea59-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-quobyte-85200acc-7db3-453c-a851-edc9d840ea59" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-85200acc-7db3-453c-a851-edc9d840ea59" acquired by "delete_volume" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca6fc0-9e3e-40f0-960c-b03a819cef37]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:44 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59
Sep 23 00:33:44 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:45 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59" returned: 0 in 0.413s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:45 devstack sudo[105525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59
Sep 23 00:33:45 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:45 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-85200acc-7db3-453c-a851-edc9d840ea59" returned: 0 in 0.274s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-85200acc-7db3-453c-a851-edc9d840ea59" released by "delete_volume" :: held 0.732s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Created reservations ['10798b09-a606-41f0-a717-e9efadb1ce6a', '77644a0f-e386-4e2b-9a05-5fd9d85ec38e', 'da8a6639-b491-4294-8432-b02843d9e5eb', '34370a5d-383a-429b-8ad4-c925e2b76412', '87457acd-7894-4c41-9fe8-5a472448b8fe'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:45 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:45 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:45 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.284s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Deleted volume successfully.
Sep 23 00:33:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-c5ab3208-d85c-494b-998f-0a134fe4243f tempest-ProjectReaderTests-454418082 None] Lock "cinder-85200acc-7db3-453c-a851-edc9d840ea59-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (f6032609-a389-407e-b312-89c129cf65bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d23a999-673c-4324-8582-6ce8c0460372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d23a999-673c-4324-8582-6ce8c0460372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848946722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fc3ede-b2cc-4220-a5b8-7f52e65d40d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:46Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb2fa4d-a6ed-43ea-a556-95810eaf1021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb2fa4d-a6ed-43ea-a556-95810eaf1021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5326d22c-1748-4fd2-9b72-fd00cc338ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5326d22c-1748-4fd2-9b72-fd00cc338ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fc3ede-b2cc-4220-a5b8-7f52e65d40d0', 'volume_name': 'volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4462a7-69c8-47ca-8e05-04c97de6cc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4462a7-69c8-47ca-8e05-04c97de6cc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb1e2f7-7c5f-4242-a71c-2c046d493e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:46 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Volume 69fc3ede-b2cc-4220-a5b8-7f52e65d40d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0', 'volume_size': 1}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848946722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fc3ede-b2cc-4220-a5b8-7f52e65d40d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:46Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Creating volume 69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:46 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:46 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 1073741824
Sep 23 00:33:46 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:46 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 1073741824" returned: 0 in 0.395s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:46 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0
Sep 23 00:33:46 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:47 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0" returned: 0 in 0.253s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb1e2f7-7c5f-4242-a71c-2c046d493e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb68940c-d8c8-40c8-9b57-9823de8ccf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:47 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Volume volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 (69fc3ede-b2cc-4220-a5b8-7f52e65d40d0): created successfully
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb68940c-d8c8-40c8-9b57-9823de8ccf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (f6032609-a389-407e-b312-89c129cf65bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d504ef4b-51c4-4015-8209-7ea579d09b94 tempest-ProjectReaderTests-454418082 None] Created volume successfully.
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Lock "cinder-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-quobyte-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0" acquired by "delete_volume" :: waited 0.015s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8ef08b-7282-4e94-9c5a-71e7bcf58987]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:47 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0
Sep 23 00:33:47 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:47 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0" returned: 0 in 0.390s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:47 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0
Sep 23 00:33:47 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:48 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0" returned: 0 in 0.245s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0" released by "delete_volume" :: held 0.681s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Created reservations ['3544701c-58b6-4ebf-a692-5b9a24713879', '41779acf-fb3b-4f22-89a5-c7bea9d5f6ae', 'edbd462f-b973-443c-813b-4a41746a561e', 'a6ba3fcb-9d3c-449b-8d28-cca1d534be13', 'ccc4ada6-8046-48ac-9eb7-d8c359513c04'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:48 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:48 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:48 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Deleted volume successfully.
Sep 23 00:33:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b5775363-c96a-4055-aaaf-ccd60d345a1b tempest-ProjectReaderTests-454418082 None] Lock "cinder-69fc3ede-b2cc-4220-a5b8-7f52e65d40d0-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (74ed9b64-0499-4ce2-88ed-7067d218ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da752cb-bd48-4d8f-931a-4d8f36b6ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da752cb-bd48-4d8f-931a-4d8f36b6ca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877624666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e86781e-322b-4cea-932b-a42554ea7e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:49Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c186e2-bb16-4896-9bc5-07a661da7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c186e2-bb16-4896-9bc5-07a661da7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b748fe41-a454-49c3-b053-7cf4eabfb37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b748fe41-a454-49c3-b053-7cf4eabfb37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e86781e-322b-4cea-932b-a42554ea7e08', 'volume_name': 'volume-9e86781e-322b-4cea-932b-a42554ea7e08', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194841cc-9211-4f79-a406-53850e357977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194841cc-9211-4f79-a406-53850e357977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af0d9f7-0f24-4322-abef-e3a908e7ef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Volume 9e86781e-322b-4cea-932b-a42554ea7e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e86781e-322b-4cea-932b-a42554ea7e08', 'volume_size': 1}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877624666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e86781e-322b-4cea-932b-a42554ea7e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b074f8d882a4b3088be4f9ac7ac2ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:49Z,use_quota=True,user_id='e93e0bb8d1664738a6305a417cb0842b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Creating volume 9e86781e-322b-4cea-932b-a42554ea7e08 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:49 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:49 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08 1073741824
Sep 23 00:33:49 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:49 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08 1073741824" returned: 0 in 0.429s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:49 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08
Sep 23 00:33:49 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:49 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08" returned: 0 in 0.255s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af0d9f7-0f24-4322-abef-e3a908e7ef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e86781e-322b-4cea-932b-a42554ea7e08', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d774022-5b9d-4d52-bfa7-ff1059fe100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Volume volume-9e86781e-322b-4cea-932b-a42554ea7e08 (9e86781e-322b-4cea-932b-a42554ea7e08): created successfully
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d774022-5b9d-4d52-bfa7-ff1059fe100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Flow 'volume_create_manager' (74ed9b64-0499-4ce2-88ed-7067d218ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-38e54f5f-026c-4866-bb84-a0ef60deab7e tempest-ProjectReaderTests-454418082 None] Created volume successfully.
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-9e86781e-322b-4cea-932b-a42554ea7e08-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Lock "cinder-9e86781e-322b-4cea-932b-a42554ea7e08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Acquiring lock "cinder-quobyte-9e86781e-322b-4cea-932b-a42554ea7e08" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-9e86781e-322b-4cea-932b-a42554ea7e08" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1736de37-4d08-4431-8040-0f4d831bbab1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:50 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08
Sep 23 00:33:50 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:50 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08" returned: 0 in 0.414s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:50 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08
Sep 23 00:33:50 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:50 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-9e86781e-322b-4cea-932b-a42554ea7e08" returned: 0 in 0.276s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Lock "cinder-quobyte-9e86781e-322b-4cea-932b-a42554ea7e08" released by "delete_volume" :: held 0.735s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Created reservations ['32192d70-0ea2-4727-81d7-bdf00a8944d0', '5e2586b5-a0cd-48b6-8ff0-853ea979621c', 'fb6d70f0-b800-4345-99fe-4cc64636fa6e', '03b5f05d-efa4-4a9e-a76c-71d60af9886b', 'c50dc709-828a-4881-8ea7-1272f6c42768'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:51 devstack sudo[105569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:33:51 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:51 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.322s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Deleted volume successfully.
Sep 23 00:33:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-bb793c41-1902-451e-9741-9384eece2689 tempest-ProjectReaderTests-454418082 None] Lock "cinder-9e86781e-322b-4cea-932b-a42554ea7e08-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:01 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:INSERT=39,cinder:UPDATE=129,cinder:SELECT=84,cinder:DELETE=10 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:34:01 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=93,cinder:INSERT=36,cinder:UPDATE=114,cinder:DELETE=6 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (d3cea116-0d63-43c7-8cd2-9d143146e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d946953a-71c5-4f27-a743-c951c25ca158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d946953a-71c5-4f27-a743-c951c25ca158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533366105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96994b23-5653-4c8b-ad02-a704b56bd90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8da66f-4189-49d8-bcc6-33e464cdd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8da66f-4189-49d8-bcc6-33e464cdd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22794d73-94c6-44e6-a2bf-472bab15e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22794d73-94c6-44e6-a2bf-472bab15e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96994b23-5653-4c8b-ad02-a704b56bd90d', 'volume_name': 'volume-96994b23-5653-4c8b-ad02-a704b56bd90d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f073c94d-0bd0-4898-a0f8-a1b2d1242b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f073c94d-0bd0-4898-a0f8-a1b2d1242b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8250f7e0-83cf-4e11-9295-30dd689970ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:04 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume 96994b23-5653-4c8b-ad02-a704b56bd90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96994b23-5653-4c8b-ad02-a704b56bd90d', 'volume_size': 1}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533366105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96994b23-5653-4c8b-ad02-a704b56bd90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating volume 96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:05 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:05 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d 1073741824
Sep 23 00:34:05 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Flow 'volume_create_manager' (f60459d9-0240-455f-8083-3e56d7ad3685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0341e8-06c3-4147-8a79-5a2ff5bdf517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0341e8-06c3-4147-8a79-5a2ff5bdf517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-944503894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0f03f5-499d-4aa5-87a6-ff46414b82bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a834b490db41469640ba7623bf891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='2aa866a09e7e4febae3500f22e739c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce023c4f-24e1-4af9-8ea9-e594b093f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce023c4f-24e1-4af9-8ea9-e594b093f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5aae3fe-55f5-4c8c-98f2-7bf333bbdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5aae3fe-55f5-4c8c-98f2-7bf333bbdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0f03f5-499d-4aa5-87a6-ff46414b82bf', 'volume_name': 'volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ef89ce-ec25-46e2-a382-5112ba31d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ef89ce-ec25-46e2-a382-5112ba31d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e66201-67d9-4a36-9d1d-55f56bfdd412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Volume ae0f03f5-499d-4aa5-87a6-ff46414b82bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf', 'volume_size': 1}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:05 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d 1073741824" returned: 0 in 0.591s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:05 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d
Sep 23 00:34:05 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Flow 'volume_create_manager' (a1a0b16f-e415-42db-86c6-e329d49ba722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe2f827-3f66-4ed3-92f9-44072c263abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe2f827-3f66-4ed3-92f9-44072c263abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e058c6-3e6c-47f9-aee0-2d6d01d35b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d725c6918b1541239f3c72ffbd47c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='44be210ac7a54fda973ba8b6e88c3bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f66b244-430c-4e91-8025-21437fef2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f66b244-430c-4e91-8025-21437fef2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e86673b-a957-44a4-b61e-f61ca94e17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e86673b-a957-44a4-b61e-f61ca94e17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e058c6-3e6c-47f9-aee0-2d6d01d35b81', 'volume_name': 'volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c4249-3aff-4599-9b74-c4454b2a72df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c4249-3aff-4599-9b74-c4454b2a72df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a540ead2-6b56-4bad-b5ec-7b96e44266f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:05 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Volume d8e058c6-3e6c-47f9-aee0-2d6d01d35b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81', 'volume_size': 1}
Sep 23 00:34:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:06 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d" returned: 0 in 0.388s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-944503894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0f03f5-499d-4aa5-87a6-ff46414b82bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a834b490db41469640ba7623bf891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='2aa866a09e7e4febae3500f22e739c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Creating volume ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:06 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8250f7e0-83cf-4e11-9295-30dd689970ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96994b23-5653-4c8b-ad02-a704b56bd90d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf 1073741824
Sep 23 00:34:06 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fee281-99f5-432d-98e8-cd58101a58a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume volume-96994b23-5653-4c8b-ad02-a704b56bd90d (96994b23-5653-4c8b-ad02-a704b56bd90d): created successfully
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fee281-99f5-432d-98e8-cd58101a58a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (d3cea116-0d63-43c7-8cd2-9d143146e88d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0d5e64b5-2d21-44c8-9cde-2345c597a965 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created volume successfully.
Sep 23 00:34:06 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf 1073741824" returned: 0 in 0.538s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:06 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf
Sep 23 00:34:06 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:06 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" returned: 0 in 0.313s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e058c6-3e6c-47f9-aee0-2d6d01d35b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d725c6918b1541239f3c72ffbd47c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='44be210ac7a54fda973ba8b6e88c3bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Creating volume d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:06 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e66201-67d9-4a36-9d1d-55f56bfdd412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 1073741824
Sep 23 00:34:07 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ace02bc-42f6-40b9-af8e-2a82f85c4846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Volume volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf (ae0f03f5-499d-4aa5-87a6-ff46414b82bf): created successfully
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ace02bc-42f6-40b9-af8e-2a82f85c4846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Flow 'volume_create_manager' (f60459d9-0240-455f-8083-3e56d7ad3685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:07 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-fc2aa383-c5cc-4133-a2f8-4d08bb0d57f9 tempest-VolumeDependencyTests-1687647174 None] Created volume successfully.
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:07 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 1073741824" returned: 0 in 0.695s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:07 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81
Sep 23 00:34:07 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:08 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81" returned: 0 in 0.331s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.801s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating offline snapshot d9fd853c-989c-4601-af71-56e76f5d6653 of volume 96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a540ead2-6b56-4bad-b5ec-7b96e44266f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614559f3-688a-41f6-adac-3d715ca62ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[504aeaac-e9e6-4794-b8cc-03da4ae6d372]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:08 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Volume volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 (d8e058c6-3e6c-47f9-aee0-2d6d01d35b81): created successfully
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614559f3-688a-41f6-adac-3d715ca62ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Flow 'volume_create_manager' (a1a0b16f-e415-42db-86c6-e329d49ba722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d082a962-8b2e-4c3c-b4df-cf39b2e635eb tempest-CinderUnicodeTest-1281867918 None] Created volume successfully.
Sep 23 00:34:08 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d
Sep 23 00:34:08 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:08 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d" returned: 0 in 0.487s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:08 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 1G
Sep 23 00:34:08 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:09 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 1G" returned: 0 in 0.571s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96994b23-5653-4c8b-ad02-a704b56bd90d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:09 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96994b23-5653-4c8b-ad02-a704b56bd90d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653
Sep 23 00:34:09 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:09 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96994b23-5653-4c8b-ad02-a704b56bd90d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653" returned: 0 in 0.497s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:09 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 is being set with open permissions: ugo+rw
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:09 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653
Sep 23 00:34:09 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Flow 'volume_create_manager' (f6f0f6c8-ba34-49c5-b645-47a057161495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c2bdb7-2164-47b3-9bd1-b452f86943ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c2bdb7-2164-47b3-9bd1-b452f86943ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1505136117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baea8f29-4e99-4b3a-aba2-1d620085a2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d725c6918b1541239f3c72ffbd47c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='44be210ac7a54fda973ba8b6e88c3bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d252c8-668f-434b-9f58-e019e8103172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d252c8-668f-434b-9f58-e019e8103172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d965d6-776f-468c-bdc5-803bf6d6e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d965d6-776f-468c-bdc5-803bf6d6e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baea8f29-4e99-4b3a-aba2-1d620085a2ef', 'volume_name': 'volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535fad00-30f8-4f44-8419-fe55ae217894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535fad00-30f8-4f44-8419-fe55ae217894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82d623-d7b8-4574-93d9-4500e04e40b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Volume baea8f29-4e99-4b3a-aba2-1d620085a2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef', 'volume_size': 1}
Sep 23 00:34:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:10 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653" returned: 0 in 0.360s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:10 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info
Sep 23 00:34:10 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Flow 'volume_create_manager' (e42093e7-d640-47e7-9c27-38e845ad9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e96a66-ef26-452b-95d3-cb4f425d26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e96a66-ef26-452b-95d3-cb4f425d26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc61a30-ade5-4913-8abc-569bb51efdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6fbbf3cb8476088e886e3f868cad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='d9a66b3db90840f0a2788617fd4069e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c66634b1-1d22-49e8-b3d6-8323b2de20f6),volume_type_id=c66634b1-1d22-49e8-b3d6-8323b2de20f6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf43d28-c99e-43bf-9631-335d95f94427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf43d28-c99e-43bf-9631-335d95f94427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fc7fe8-39d9-47a4-a06d-c36bfe71496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info" returned: 0 in 0.332s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:10 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info is being set with open permissions: ugo+rw
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:10 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info
Sep 23 00:34:10 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fc7fe8-39d9-47a4-a06d-c36bfe71496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6dc61a30-ade5-4913-8abc-569bb51efdd5', 'volume_name': 'volume-6dc61a30-ade5-4913-8abc-569bb51efdd5', 'volume_size': 1, 'image_id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d4fbfee96069105baf5b38019d78ac3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2a6fbbf3cb8476088e886e3f868cad8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f28d01f9799ca542490b17778c389263d1a966a7bff2a347628b3fdae572362bb324c57b6c1bb1286bdc5944e769ea8aeff7458b16c29f497181c3fd820fa45', 'id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf1b7e00>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d048d-bbc5-4cfc-9f3f-db31594b152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d048d-bbc5-4cfc-9f3f-db31594b152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3a3268-0ab5-432c-ae12-da678a7d4adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Volume 6dc61a30-ade5-4913-8abc-569bb51efdd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6dc61a30-ade5-4913-8abc-569bb51efdd5', 'volume_size': 1, 'image_id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d4fbfee96069105baf5b38019d78ac3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2a6fbbf3cb8476088e886e3f868cad8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f28d01f9799ca542490b17778c389263d1a966a7bff2a347628b3fdae572362bb324c57b6c1bb1286bdc5944e769ea8aeff7458b16c29f497181c3fd820fa45', 'id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf1b7e00>}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Trying to clone 6dc61a30-ade5-4913-8abc-569bb51efdd5 from image 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:34:10 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.info" returned: 0 in 0.288s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.060s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Creating offline snapshot 83330806-b220-4fe0-a813-b094fd5879d4 of volume ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:10 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dd90ab12-c279-4264-8ada-4c8b42f0e17a tempest-CreateVolumesFromSnapshotTest-1378675053 None] Create snapshot completed successfully
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca8400-df5e-457b-a6b6-5e923ae2dea0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:34:10 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae0429-c958-41b6-a80f-9a53a7618be6]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:10 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf
Sep 23 00:34:10 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:10 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD
Sep 23 00:34:10 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:11 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:11 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:11 devstack sudo[105676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 1G
Sep 23 00:34:11 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:11 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD
Sep 23 00:34:11 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:11 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Temporary image 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef is fetched for user d9a66b3db90840f0a2788617fd4069e4. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6bc977-6398-4a71-9619-8f84e3dd4503]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:11 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 1G" returned: 0 in 0.514s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:11 devstack sudo[105687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4
Sep 23 00:34:11 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:11 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD
Sep 23 00:34:11 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:12 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:12 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (45b8535a-720f-48dc-b0df-d424b58ffac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f7f718-4eed-4937-877c-e559591074e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4" returned: 0 in 0.477s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:12 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 is being set with open permissions: ugo+rw
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f7f718-4eed-4937-877c-e559591074e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482044241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10753c99-e41f-4084-90f4-c60923a4ffe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1df333f-171d-461f-aad5-54f119ddedd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1df333f-171d-461f-aad5-54f119ddedd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865754c7-bdaa-4ce1-bc0b-2595e00bc6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865754c7-bdaa-4ce1-bc0b-2595e00bc6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10753c99-e41f-4084-90f4-c60923a4ffe8', 'volume_name': 'volume-10753c99-e41f-4084-90f4-c60923a4ffe8', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6396ed40-4673-4d6d-9cb1-004cbe93edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6396ed40-4673-4d6d-9cb1-004cbe93edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a6fd2-ac8e-49a4-8308-a41a358b8955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume 10753c99-e41f-4084-90f4-c60923a4ffe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10753c99-e41f-4084-90f4-c60923a4ffe8', 'volume_size': 1}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:12 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD
Sep 23 00:34:12 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:12 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (c2d7b931-6423-4851-8989-d5d40aeea48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677469f1-4d8a-48c1-ab39-8e84787cf40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4" returned: 0 in 0.457s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677469f1-4d8a-48c1-ab39-8e84787cf40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943641897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ce77f6-ccde-4143-825e-8d2fe68c073d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:13Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f692f3b-c38a-420a-847c-f7b4f59136b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f692f3b-c38a-420a-847c-f7b4f59136b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fe62ef-5a58-476e-9268-e5baca36fe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fe62ef-5a58-476e-9268-e5baca36fe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ce77f6-ccde-4143-825e-8d2fe68c073d', 'volume_name': 'volume-05ce77f6-ccde-4143-825e-8d2fe68c073d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b938a6-2945-4543-b434-573980b90ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b938a6-2945-4543-b434-573980b90ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b989706-0371-46fb-9a08-1bd6200a7716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume 05ce77f6-ccde-4143-825e-8d2fe68c073d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ce77f6-ccde-4143-825e-8d2fe68c073d', 'volume_size': 1}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD" returned: 1 in 0.586s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:12 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info
Sep 23 00:34:12 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:13 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (de00d0fc-2081-46b4-8eee-31e9fa33ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2673d4-3021-468d-a023-dcc0e538a9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info" returned: 0 in 0.343s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:13 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info is being set with open permissions: ugo+rw
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2673d4-3021-468d-a023-dcc0e538a9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800279085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9b1d80-e04d-49e6-85dd-3d1755287b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:13Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de52f08-3f72-4de0-a315-6be261d64199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de52f08-3f72-4de0-a315-6be261d64199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0749e693-0cc9-43b0-b85c-39be1b8925ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0749e693-0cc9-43b0-b85c-39be1b8925ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9b1d80-e04d-49e6-85dd-3d1755287b33', 'volume_name': 'volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e162592b-c027-477d-8e01-352c30fe117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e162592b-c027-477d-8e01-352c30fe117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1996d5-a8f0-4e85-8803-81e2e77a9977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume 0b9b1d80-e04d-49e6-85dd-3d1755287b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33', 'volume_size': 1}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:13 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.info" returned: 0 in 0.294s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.611s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1505136117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baea8f29-4e99-4b3a-aba2-1d620085a2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d725c6918b1541239f3c72ffbd47c3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='44be210ac7a54fda973ba8b6e88c3bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Creating volume baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:13 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:13 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef 1073741824
Sep 23 00:34:13 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e5229ff9-b7a2-4457-a5d7-26ef58d190fc tempest-VolumeDependencyTests-1687647174 None] Create snapshot completed successfully
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (f7922dba-fed0-4320-8c25-ef8441edf8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d165655d-526a-4844-b0fe-560ab2a021b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d165655d-526a-4844-b0fe-560ab2a021b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411920495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba04af1a-e390-41e0-9959-9d4f29cdb3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b7e4cb-cf03-4ca6-b922-20e05eb04a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b7e4cb-cf03-4ca6-b922-20e05eb04a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5998ae78-1ae8-428d-b01f-63eab9fbd1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5998ae78-1ae8-428d-b01f-63eab9fbd1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba04af1a-e390-41e0-9959-9d4f29cdb3ee', 'volume_name': 'volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb8f872-108d-41c5-9f55-3eacf2115949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb8f872-108d-41c5-9f55-3eacf2115949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d34ea19-13e7-4e32-8dcc-46fb17edb1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume ba04af1a-e390-41e0-9959-9d4f29cdb3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee', 'volume_size': 1}
Sep 23 00:34:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (6847a609-d441-46df-a94b-78ec77616626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fde08b-6534-4a54-adff-52372ec2182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fde08b-6534-4a54-adff-52372ec2182b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1041036783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f892133-7f31-4f89-b3ec-5c5fd2d5a765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0542a3-b882-4d26-9f08-e006ec5ca369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0542a3-b882-4d26-9f08-e006ec5ca369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3909613-6734-4856-89fc-0586b7fbb95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3909613-6734-4856-89fc-0586b7fbb95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f892133-7f31-4f89-b3ec-5c5fd2d5a765', 'volume_name': 'volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0ace96-413e-4a68-b70f-48f9d1f898ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0ace96-413e-4a68-b70f-48f9d1f898ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e06801-6112-4cb3-b381-52dfe1a70963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume 1f892133-7f31-4f89-b3ec-5c5fd2d5a765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765', 'volume_size': 1}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:14 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef 1073741824" returned: 0 in 0.701s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:14 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef
Sep 23 00:34:14 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:14 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef" returned: 0 in 0.327s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482044241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10753c99-e41f-4084-90f4-c60923a4ffe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating volume 10753c99-e41f-4084-90f4-c60923a4ffe8 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:14 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:14 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8 1073741824
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82d623-d7b8-4574-93d9-4500e04e40b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e943122-0458-4ce5-9875-bffe46c5cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Volume volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef (baea8f29-4e99-4b3a-aba2-1d620085a2ef): created successfully
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e943122-0458-4ce5-9875-bffe46c5cc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Flow 'volume_create_manager' (f6f0f6c8-ba34-49c5-b645-47a057161495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7e501e3d-f050-444f-b51c-e3b3494cba6a tempest-CinderUnicodeTest-1281867918 None] Created volume successfully.
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Flow 'volume_create_manager' (45420241-315e-4a52-ba3b-e46bfcda336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bdf2f2-d101-4b3d-bb10-70e34e9351b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bdf2f2-d101-4b3d-bb10-70e34e9351b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-950138470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bfc401-fdbd-4fed-88ab-29e0b5f7c259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a834b490db41469640ba7623bf891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83330806-b220-4fe0-a813-b094fd5879d4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:15Z,use_quota=True,user_id='2aa866a09e7e4febae3500f22e739c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47891b83-58aa-44d5-8961-7798e5c91703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47891b83-58aa-44d5-8961-7798e5c91703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8dd136-0224-4bdd-b970-fb641299d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8dd136-0224-4bdd-b970-fb641299d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32bfc401-fdbd-4fed-88ab-29e0b5f7c259', 'volume_name': 'volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259', 'volume_size': 1, 'snapshot_id': '83330806-b220-4fe0-a813-b094fd5879d4'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010ec468-f374-46b0-b289-0e3813dcb983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010ec468-f374-46b0-b289-0e3813dcb983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2455cfec-4bba-4095-bc24-69e924707329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Volume 32bfc401-fdbd-4fed-88ab-29e0b5f7c259: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259', 'volume_size': 1, 'snapshot_id': '83330806-b220-4fe0-a813-b094fd5879d4'}
Sep 23 00:34:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:15 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8 1073741824" returned: 0 in 0.517s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8
Sep 23 00:34:15 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:15 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8" returned: 0 in 0.267s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.674s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943641897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ce77f6-ccde-4143-825e-8d2fe68c073d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:13Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating volume 05ce77f6-ccde-4143-825e-8d2fe68c073d {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:15 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a6fd2-ac8e-49a4-8308-a41a358b8955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10753c99-e41f-4084-90f4-c60923a4ffe8', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:15 devstack sudo[105736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d 1073741824
Sep 23 00:34:15 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bb5303-f4d1-4ed3-a9a1-bb5b7906dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume volume-10753c99-e41f-4084-90f4-c60923a4ffe8 (10753c99-e41f-4084-90f4-c60923a4ffe8): created successfully
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bb5303-f4d1-4ed3-a9a1-bb5b7906dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (45b8535a-720f-48dc-b0df-d424b58ffac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6fd9bbe3-968e-419e-8077-4cd29475bc3f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created volume successfully.
Sep 23 00:34:15 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d 1073741824" returned: 0 in 0.490s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d
Sep 23 00:34:15 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d" returned: 0 in 0.286s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc61a30-ade5-4913-8abc-569bb51efdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6fbbf3cb8476088e886e3f868cad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='d9a66b3db90840f0a2788617fd4069e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c66634b1-1d22-49e8-b3d6-8323b2de20f6),volume_type_id=c66634b1-1d22-49e8-b3d6-8323b2de20f6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Creating volume 6dc61a30-ade5-4913-8abc-569bb51efdd5 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:16 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b989706-0371-46fb-9a08-1bd6200a7716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ce77f6-ccde-4143-825e-8d2fe68c073d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:16 devstack sudo[105745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 1073741824
Sep 23 00:34:16 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780df762-6ca3-4afe-80ff-1bfde922ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:16 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume volume-05ce77f6-ccde-4143-825e-8d2fe68c073d (05ce77f6-ccde-4143-825e-8d2fe68c073d): created successfully
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780df762-6ca3-4afe-80ff-1bfde922ee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (c2d7b931-6423-4851-8989-d5d40aeea48f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ed913b2c-253c-4ecb-95ca-c6224efbe060 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created volume successfully.
Sep 23 00:34:16 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 1073741824" returned: 0 in 0.515s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:16 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5
Sep 23 00:34:16 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5" returned: 0 in 0.267s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.904s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800279085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9b1d80-e04d-49e6-85dd-3d1755287b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:13Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating volume 0b9b1d80-e04d-49e6-85dd-3d1755287b33 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:17 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 1073741824
Sep 23 00:34:17 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Attempting download of 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef ((None, [{'url': 'file:///opt/stack/data/glance/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'metadata': {}}])) to volume 6dc61a30-ade5-4913-8abc-569bb51efdd5. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94bda2-a6de-4bf4-8708-7ba3eca97f84]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz
Sep 23 00:34:17 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz" returned: 0 in 0.366s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 1073741824" returned: 0 in 0.500s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33
Sep 23 00:34:17 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz
Sep 23 00:34:17 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33" returned: 0 in 0.312s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.303s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411920495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba04af1a-e390-41e0-9959-9d4f29cdb3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating volume ba04af1a-e390-41e0-9959-9d4f29cdb3ee {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:17 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:17 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz" returned: 1 in 0.407s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_iqp73aoz' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[445e74c0-f094-4e7c-84a8-e86ec5c7ea40]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee 1073741824
Sep 23 00:34:17 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1996d5-a8f0-4e85-8803-81e2e77a9977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34af11a8-c09a-4c26-984c-55f08976b4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:18 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 (0b9b1d80-e04d-49e6-85dd-3d1755287b33): created successfully
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34af11a8-c09a-4c26-984c-55f08976b4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (de00d0fc-2081-46b4-8eee-31e9fa33ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9237e8fe-5f49-47c0-9edb-8a222e2608ff tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created volume successfully.
Sep 23 00:34:18 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD
Sep 23 00:34:18 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee 1073741824" returned: 0 in 0.615s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[105779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD
Sep 23 00:34:18 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee
Sep 23 00:34:18 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef was raw, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5
Sep 23 00:34:18 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee" returned: 0 in 0.351s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.827s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1041036783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f892133-7f31-4f89-b3ec-5c5fd2d5a765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e9aa38858e422ead65cd612a8b435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='e8ac13677a004d39bc534cddd6289f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Creating volume 1f892133-7f31-4f89-b3ec-5c5fd2d5a765 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:18 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 1073741824
Sep 23 00:34:19 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d34ea19-13e7-4e32-8dcc-46fb17edb1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12430323-4cf8-4aba-a8c3-89dc80a941ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:19 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee (ba04af1a-e390-41e0-9959-9d4f29cdb3ee): created successfully
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12430323-4cf8-4aba-a8c3-89dc80a941ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (f7922dba-fed0-4320-8c25-ef8441edf8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1f232b2e-3603-4479-9787-c7538ef2f91d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created volume successfully.
Sep 23 00:34:19 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5" returned: 0 in 0.534s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_905ca83f-a6c6-4ce8-98fc-21365ff8f2ef_qdsbtcp8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:34:19 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 1G
Sep 23 00:34:19 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 1073741824" returned: 0 in 0.638s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765
Sep 23 00:34:19 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 1G" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Downloaded image 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef ((None, [{'url': 'file:///opt/stack/data/glance/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'metadata': {}}])) to volume 6dc61a30-ade5-4913-8abc-569bb51efdd5 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Temporary image 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef for user d9a66b3db90840f0a2788617fd4069e4 is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Marking volume 6dc61a30-ade5-4913-8abc-569bb51efdd5 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Copying metadata from image 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef to 6dc61a30-ade5-4913-8abc-569bb51efdd5. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Creating volume glance metadata for volume 6dc61a30-ade5-4913-8abc-569bb51efdd5 backed by image 905ca83f-a6c6-4ce8-98fc-21365ff8f2ef with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6d4fbfee96069105baf5b38019d78ac3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3a3268-0ab5-432c-ae12-da678a7d4adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc61a30-ade5-4913-8abc-569bb51efdd5', 'volume_size': 1, 'image_id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d4fbfee96069105baf5b38019d78ac3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2a6fbbf3cb8476088e886e3f868cad8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f28d01f9799ca542490b17778c389263d1a966a7bff2a347628b3fdae572362bb324c57b6c1bb1286bdc5944e769ea8aeff7458b16c29f497181c3fd820fa45', 'id': '905ca83f-a6c6-4ce8-98fc-21365ff8f2ef', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/905ca83f-a6c6-4ce8-98fc-21365ff8f2ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afdf1b7e00>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:19 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196306a6-a037-49b1-aa4a-71592c10f79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765" returned: 0 in 0.313s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.080s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-quobyte-83330806-b220-4fe0-a813-b094fd5879d4-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:20 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Volume volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 (6dc61a30-ade5-4913-8abc-569bb51efdd5): created successfully
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196306a6-a037-49b1-aa4a-71592c10f79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Flow 'volume_create_manager' (e42093e7-d640-47e7-9c27-38e845ad9327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e06801-6112-4cb3-b381-52dfe1a70963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997e30d8-943c-4da5-b4eb-550be8739271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-83330806-b220-4fe0-a813-b094fd5879d4-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Creating volume 32bfc401-fdbd-4fed-88ab-29e0b5f7c259 from snapshot 83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-quobyte-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:20 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Volume volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 (1f892133-7f31-4f89-b3ec-5c5fd2d5a765): created successfully
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997e30d8-943c-4da5-b4eb-550be8739271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Flow 'volume_create_manager' (6847a609-d441-46df-a94b-78ec77616626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-89310524-5d99-4dfc-b285-d712492828d2 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Created volume successfully.
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] snapshot: 83330806-b220-4fe0-a813-b094fd5879d4, volume: 32bfc401-fdbd-4fed-88ab-29e0b5f7c259,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:34:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e059d1bc-ed6b-4232-a6a8-e0c88771a6c4 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created volume successfully.
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af68e0-6499-4724-95a5-98e3f5de558b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4
Sep 23 00:34:20 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4" returned: 0 in 0.453s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61e880-6d5c-450a-a9e4-8ee418d7547f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-1f892133-7f31-4f89-b3ec-5c5fd2d5a765-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:20 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf
Sep 23 00:34:20 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-1f892133-7f31-4f89-b3ec-5c5fd2d5a765-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-1f892133-7f31-4f89-b3ec-5c5fd2d5a765" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-1f892133-7f31-4f89-b3ec-5c5fd2d5a765" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac87e49-6715-4f86-896c-dcb18b2b2c48]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765
Sep 23 00:34:21 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Acquiring lock "cinder-6dc61a30-ade5-4913-8abc-569bb51efdd5-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "cinder-6dc61a30-ade5-4913-8abc-569bb51efdd5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:21 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" returned: 0 in 0.660s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259
Sep 23 00:34:21 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Acquiring lock "cinder-quobyte-6dc61a30-ade5-4913-8abc-569bb51efdd5" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "cinder-quobyte-6dc61a30-ade5-4913-8abc-569bb51efdd5" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3739dc-c10c-4b1a-8f4b-5dda872c3ffe]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5
Sep 23 00:34:21 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765" returned: 0 in 0.599s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765
Sep 23 00:34:21 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f892133-7f31-4f89-b3ec-5c5fd2d5a765" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-1f892133-7f31-4f89-b3ec-5c5fd2d5a765" released by "delete_volume" :: held 1.022s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:22 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5" returned: 0 in 0.594s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5
Sep 23 00:34:22 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['f5fb820e-933b-45a9-b70f-eede139843ab', 'c92e3de6-aabb-4ccb-b8e9-1b04ca0a4690', 'a245944d-0e8e-4084-b947-ac3c9371f9f8', '52dcd651-2cca-4ac8-ab64-51c5eac04a4e', '22a480fc-46a3-4aa5-9ad2-c42c70e3156e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:22 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6dc61a30-ade5-4913-8abc-569bb51efdd5" returned: 0 in 0.571s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "cinder-quobyte-6dc61a30-ade5-4913-8abc-569bb51efdd5" released by "delete_volume" :: held 1.242s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Created reservations ['d2372bd5-e9b2-4914-94fb-218ec42ac402', 'c2e9d691-5a5d-4961-b6fa-c5bc2356ddda', '71fb3e00-0fdc-495f-bd2a-569eaab88ee1', '726e2326-3908-43b3-b2d9-6532d684b856', '0959b7fd-a290-4e2b-b7ef-8ea7b48922f0'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:22 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.546s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleted volume successfully.
Sep 23 00:34:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-10264647-9061-4583-93fb-ed12fa40507f tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-1f892133-7f31-4f89-b3ec-5c5fd2d5a765-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:23 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-ba04af1a-e390-41e0-9959-9d4f29cdb3ee-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-ba04af1a-e390-41e0-9959-9d4f29cdb3ee-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-ba04af1a-e390-41e0-9959-9d4f29cdb3ee" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-ba04af1a-e390-41e0-9959-9d4f29cdb3ee" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4af0a4-4917-45ef-a4b7-9a0ed7ed50be]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.637s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:23 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Deleted volume successfully.
Sep 23 00:34:23 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6613a682-1d56-4ca1-aa55-33d198520b61 tempest-VolumeAndVolumeTypeFromImageTest-398917633 None] Lock "cinder-6dc61a30-ade5-4913-8abc-569bb51efdd5-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:23 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee
Sep 23 00:34:23 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:24 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee" returned: 0 in 0.777s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:24 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee
Sep 23 00:34:24 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:24 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ba04af1a-e390-41e0-9959-9d4f29cdb3ee" returned: 0 in 0.471s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-ba04af1a-e390-41e0-9959-9d4f29cdb3ee" released by "delete_volume" :: held 1.360s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:24 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['70edafbe-4589-420b-8832-10aea2fa0739', 'f0ec54c8-08ec-4a30-bbbc-6beba6e87b8d', 'db6545f0-1e62-4472-a0ea-f97b65e564d3', 'f3dcc4de-1127-4b70-99ec-8de452dae47f', '42d5178e-b56b-44d3-8511-550e41a8b2ce'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:25 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:25 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:25 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.516s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:25 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleted volume successfully.
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f6d2d214-e764-4550-af6b-21cac6212def tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-ba04af1a-e390-41e0-9959-9d4f29cdb3ee-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-0b9b1d80-e04d-49e6-85dd-3d1755287b33-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-0b9b1d80-e04d-49e6-85dd-3d1755287b33-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-0b9b1d80-e04d-49e6-85dd-3d1755287b33" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-0b9b1d80-e04d-49e6-85dd-3d1755287b33" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e60ae-617f-4527-b19e-505602a2aaac]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:26 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33
Sep 23 00:34:26 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:26 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33" returned: 0 in 0.634s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:26 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33
Sep 23 00:34:26 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:27 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0b9b1d80-e04d-49e6-85dd-3d1755287b33" returned: 0 in 0.566s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-0b9b1d80-e04d-49e6-85dd-3d1755287b33" released by "delete_volume" :: held 1.306s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['3ae5295a-3a6e-4ace-ae7a-7708e53e6f2d', 'ea266904-2472-4f14-b436-d9d610e65174', 'b7912ac1-0588-41f7-8e98-a504de9d3539', '6ef5cbbd-a481-4ad1-b05e-6cf8aed55804', '09c1896c-e82f-4c80-b1b7-b95d57328673'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:27 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:27 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:27 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.407s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleted volume successfully.
Sep 23 00:34:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1a69e626-15a8-46ed-a688-164b26d5b182 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-0b9b1d80-e04d-49e6-85dd-3d1755287b33-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-05ce77f6-ccde-4143-825e-8d2fe68c073d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-05ce77f6-ccde-4143-825e-8d2fe68c073d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-05ce77f6-ccde-4143-825e-8d2fe68c073d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-05ce77f6-ccde-4143-825e-8d2fe68c073d" acquired by "delete_volume" :: waited 0.053s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cbf4b5-80d4-469a-bf49-1647f35235d9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:28 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d
Sep 23 00:34:28 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:29 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d" returned: 0 in 0.732s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:29 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d
Sep 23 00:34:29 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:29 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-05ce77f6-ccde-4143-825e-8d2fe68c073d" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-05ce77f6-ccde-4143-825e-8d2fe68c073d" released by "delete_volume" :: held 1.287s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['0e5b88f3-beca-48cd-aa6c-df57a0872a38', '6230ff19-42d4-4032-b98e-bde5ecf99033', '9737acdc-48cc-4f82-9908-536af202ef7b', 'a7532cc7-2282-4c3f-ac11-28516ba49ede', 'dc0e4f51-afe7-4cf6-8c0d-cc3a1ba395d1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:30 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" returned: 0 in 8.719s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:34:30 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Converted 1024.00 MB image at 117.43 MB/s
Sep 23 00:34:30 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 is being set with open permissions: ugo+rw
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259
Sep 23 00:34:30 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.314s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:30 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleted volume successfully.
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-63c16ae0-e90a-4879-9259-63108a8c33e0 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-05ce77f6-ccde-4143-825e-8d2fe68c073d-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:30 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" returned: 0 in 0.320s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" released by "_copy_volume_from_snapshot" :: held 10.261s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-83330806-b220-4fe0-a813-b094fd5879d4-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" released by "_create_volume_from_snapshot" :: held 10.357s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.412s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.957s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Creating offline snapshot b3959fb8-b7d2-4e1a-adfd-039dad3d3cba of volume baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2455cfec-4bba-4095-bc24-69e924707329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259', 'volume_size': 1, 'snapshot_id': '83330806-b220-4fe0-a813-b094fd5879d4'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac04a7f-bdb2-4570-8301-15ae58062ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[da716ad0-492e-4816-bccb-2717a5735dbf]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Volume volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 (32bfc401-fdbd-4fed-88ab-29e0b5f7c259): created successfully
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac04a7f-bdb2-4570-8301-15ae58062ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Flow 'volume_create_manager' (45420241-315e-4a52-ba3b-e46bfcda336b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:30 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cfa3e703-ae12-4c0c-a2cd-230090642871 tempest-VolumeDependencyTests-1687647174 None] Created volume successfully.
Sep 23 00:34:30 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef
Sep 23 00:34:30 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-10753c99-e41f-4084-90f4-c60923a4ffe8-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-10753c99-e41f-4084-90f4-c60923a4ffe8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-10753c99-e41f-4084-90f4-c60923a4ffe8" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-10753c99-e41f-4084-90f4-c60923a4ffe8" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9570ee-c43d-49f1-b3de-6cff3bdc19ad]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef" returned: 0 in 0.413s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba 1G
Sep 23 00:34:30 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8
Sep 23 00:34:30 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8" returned: 0 in 0.424s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8
Sep 23 00:34:31 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba 1G" returned: 0 in 0.557s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-83330806-b220-4fe0-a813-b094fd5879d4-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-83330806-b220-4fe0-a813-b094fd5879d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:31 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-quobyte-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:31 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-quobyte-83330806-b220-4fe0-a813-b094fd5879d4" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-83330806-b220-4fe0-a813-b094fd5879d4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Deleting offline snapshot 83330806-b220-4fe0-a813-b094fd5879d4 of volume ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] snapshot_file for this snap is: volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319c3fb-40fa-4920-a226-a66e85158835]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-10753c99-e41f-4084-90f4-c60923a4ffe8" returned: 0 in 0.425s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-10753c99-e41f-4084-90f4-c60923a4ffe8" released by "delete_volume" :: held 0.924s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['f60651d2-4308-4599-bf0f-6b58c7ec8008', '36508bd5-32f4-4e60-b55f-afa9743101cb', '2bdb1869-438f-4b94-b1ca-1b11ed6a7070', '7bd86b15-a718-4e16-87ba-aa27beb05f20', '1733779d-249c-403a-a233-ecab3c167067'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:31 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4
Sep 23 00:34:31 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:31 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" returned: 0 in 0.526s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:31 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba is being set with open permissions: ugo+rw
Sep 23 00:34:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba
Sep 23 00:34:32 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (535cf7ca-2eb9-4fcd-89a2-5026e769426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c91f761-1d50-4990-8972-f095fa0eac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c91f761-1d50-4990-8972-f095fa0eac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-42549367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153d3c85-a070-4473-b77e-34973200c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:32Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66c0f49-f828-44a6-aa36-9d4227ed260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66c0f49-f828-44a6-aa36-9d4227ed260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ca02eb-8d7f-4ce1-ad07-9d2c924dbee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ca02eb-8d7f-4ce1-ad07-9d2c924dbee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153d3c85-a070-4473-b77e-34973200c3b0', 'volume_name': 'volume-153d3c85-a070-4473-b77e-34973200c3b0', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fac80d-2113-4a17-a17f-29c3a6f69f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fac80d-2113-4a17-a17f-29c3a6f69f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f880fad6-4a96-4177-bfd8-62dc6cbf6c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Volume 153d3c85-a070-4473-b77e-34973200c3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153d3c85-a070-4473-b77e-34973200c3b0', 'volume_size': 1}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:32 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" returned: 0 in 0.361s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4" returned: 0 in 0.753s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.459s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:32 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleted volume successfully.
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1eb35b-9bda-4da5-af09-c2e72dfc422b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1fd11249-2967-4c14-b18f-97b90d02e09d tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-10753c99-e41f-4084-90f4-c60923a4ffe8-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:32 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info
Sep 23 00:34:32 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf
Sep 23 00:34:32 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (5a816abe-3f46-4d7b-b8ad-795c0e646c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55850385-c720-4d23-98bc-a2ce57e58f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55850385-c720-4d23-98bc-a2ce57e58f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613154968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693a5af0-eeea-427c-ac93-67690a00d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:33Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea47036-fbf4-43f9-a0a5-e0aff2a36aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea47036-fbf4-43f9-a0a5-e0aff2a36aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b87be1-fb88-4c7b-adc8-4d4855599f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b87be1-fb88-4c7b-adc8-4d4855599f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693a5af0-eeea-427c-ac93-67690a00d320', 'volume_name': 'volume-693a5af0-eeea-427c-ac93-67690a00d320', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f79a06-14e9-490a-a7b5-676b284e41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f79a06-14e9-490a-a7b5-676b284e41d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13954f80-0a88-4ab2-8d81-9ed1088ee321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Volume 693a5af0-eeea-427c-ac93-67690a00d320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693a5af0-eeea-427c-ac93-67690a00d320', 'volume_size': 1}
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:32 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info" returned: 0 in 0.314s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info is being set with open permissions: ugo+rw
Sep 23 00:34:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info
Sep 23 00:34:32 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:33 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" returned: 0 in 0.669s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4
Sep 23 00:34:33 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:33 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.info" returned: 0 in 0.390s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-42549367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153d3c85-a070-4473-b77e-34973200c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:32Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Creating volume 153d3c85-a070-4473-b77e-34973200c3b0 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:33 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0 1073741824
Sep 23 00:34:33 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-d9fd853c-989c-4601-af71-56e76f5d6653-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a04af94f-a60a-463f-bb04-dab86cd70c48 tempest-CinderUnicodeTest-1281867918 None] Create snapshot completed successfully
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (cae34220-c488-4f8b-b1f5-96761f5e0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f16be4c-ca96-4527-b1ca-4cbb52e1029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-d9fd853c-989c-4601-af71-56e76f5d6653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.125s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-96994b23-5653-4c8b-ad02-a704b56bd90d" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f16be4c-ca96-4527-b1ca-4cbb52e1029f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336486879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60580fba-cdb2-4da8-8a03-5fb8ec682440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:33Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542f02a7-db5d-42d2-8716-c1ce77ce8562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542f02a7-db5d-42d2-8716-c1ce77ce8562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f51a9d2-2a16-4d83-b175-0b34960e6799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f51a9d2-2a16-4d83-b175-0b34960e6799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60580fba-cdb2-4da8-8a03-5fb8ec682440', 'volume_name': 'volume-60580fba-cdb2-4da8-8a03-5fb8ec682440', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b1e04-75d1-46eb-890a-eb52158aed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b1e04-75d1-46eb-890a-eb52158aed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb650b97-7d06-4204-81cb-0eebb564b867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Volume 60580fba-cdb2-4da8-8a03-5fb8ec682440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60580fba-cdb2-4da8-8a03-5fb8ec682440', 'volume_size': 1}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-96994b23-5653-4c8b-ad02-a704b56bd90d" acquired by "delete_snapshot" :: waited 0.118s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-d9fd853c-989c-4601-af71-56e76f5d6653" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-d9fd853c-989c-4601-af71-56e76f5d6653" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleting offline snapshot d9fd853c-989c-4601-af71-56e76f5d6653 of volume 96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] snapshot_file for this snap is: volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-b3959fb8-b7d2-4e1a-adfd-039dad3d3cba-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73be6be-680d-4da9-b903-c3d022dd3878]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-b3959fb8-b7d2-4e1a-adfd-039dad3d3cba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-quobyte-baea8f29-4e99-4b3a-aba2-1d620085a2ef" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-baea8f29-4e99-4b3a-aba2-1d620085a2ef" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-quobyte-b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Deleting offline snapshot b3959fb8-b7d2-4e1a-adfd-039dad3d3cba of volume baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] snapshot_file for this snap is: volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:34:33 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4" returned: 0 in 0.765s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b5b85-06c7-435d-8009-3df875c7d33e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4
Sep 23 00:34:33 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:33 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653
Sep 23 00:34:33 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:34 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba
Sep 23 00:34:34 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (a81020f9-4835-4323-9b5f-edcec93189db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ec92a5-fa1d-419e-b5aa-18218234b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ec92a5-fa1d-419e-b5aa-18218234b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760890484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6422f290-0fa4-4d05-a03f-7607b007e9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:34Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7340c6f1-33d6-454a-9edf-846e91f08c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7340c6f1-33d6-454a-9edf-846e91f08c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f03b84-20ce-4532-8aaa-e625b67a08a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f03b84-20ce-4532-8aaa-e625b67a08a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6422f290-0fa4-4d05-a03f-7607b007e9b9', 'volume_name': 'volume-6422f290-0fa4-4d05-a03f-7607b007e9b9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035da715-f0a4-40a9-b692-2356a004a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035da715-f0a4-40a9-b692-2356a004a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e983f-fc30-405c-a5e7-489307ad829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Volume 6422f290-0fa4-4d05-a03f-7607b007e9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6422f290-0fa4-4d05-a03f-7607b007e9b9', 'volume_size': 1}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0 1073741824" returned: 0 in 1.019s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[105996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0
Sep 23 00:34:34 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf.83330806-b220-4fe0-a813-b094fd5879d4" returned: 0 in 0.503s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-83330806-b220-4fe0-a813-b094fd5879d4" released by "_delete_snapshot" :: held 2.862s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" released by "delete_snapshot" :: held 2.902s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:34 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653" returned: 0 in 0.840s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96994b23-5653-4c8b-ad02-a704b56bd90d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f92c2-b661-43b2-ae69-4948e2c5421b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" returned: 0 in 0.720s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Created reservations ['e8a5c730-0241-4ec6-9899-6df69f0eb772', '405f49cb-596f-45a8-823b-533b68e15644', '31296333-67ca-4646-8957-b35891dee2dd', 'a810600e-df6b-4a6c-ae28-b24e62dda105', '28cf45c8-7a1a-4acc-bb88-470bc922ba31'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6effd210-7e14-475c-8b13-e47fe9b4115f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d
Sep 23 00:34:34 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0" returned: 0 in 0.400s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613154968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693a5af0-eeea-427c-ac93-67690a00d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:33Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Creating volume 693a5af0-eeea-427c-ac93-67690a00d320 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:34 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320 1073741824
Sep 23 00:34:34 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (f7c38952-e9f8-4274-ab87-0d31ae3bf1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769f8ec3-89f3-4744-9115-d377c033149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f880fad6-4a96-4177-bfd8-62dc6cbf6c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153d3c85-a070-4473-b77e-34973200c3b0', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba3e293-4015-4195-a6e4-27a113539fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-ae0f03f5-499d-4aa5-87a6-ff46414b82bf-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:34 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Volume volume-153d3c85-a070-4473-b77e-34973200c3b0 (153d3c85-a070-4473-b77e-34973200c3b0): created successfully
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba3e293-4015-4195-a6e4-27a113539fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (535cf7ca-2eb9-4fcd-89a2-5026e769426c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769f8ec3-89f3-4744-9115-d377c033149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1658550082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea20220a-c31b-4759-bd1d-71979fcc3cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:35Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c47e57f-c5d4-4e9c-80d1-48763cd07e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c47e57f-c5d4-4e9c-80d1-48763cd07e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbd8dd6-e587-4fa3-bbb4-0abb8cc87359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbd8dd6-e587-4fa3-bbb4-0abb8cc87359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea20220a-c31b-4759-bd1d-71979fcc3cd8', 'volume_name': 'volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26fc5d3-d966-45ed-ba91-9827debaea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26fc5d3-d966-45ed-ba91-9827debaea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:35 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92c5438-16de-4f62-a38c-62837892e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Volume ea20220a-c31b-4759-bd1d-71979fcc3cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8', 'volume_size': 1}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-ae0f03f5-499d-4aa5-87a6-ff46414b82bf-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f3ab1a9d-9795-46a5-baca-572d3819985c tempest-CreateVolumesFromImageTest-1057492786 None] Created volume successfully.
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d" returned: 0 in 0.519s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Delete snapshot completed successfully.
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0589bd5a-a9ab-45cb-9557-d28f9e465872 tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-83330806-b220-4fe0-a813-b094fd5879d4-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:35 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653
Sep 23 00:34:35 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-quobyte-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[375fbb27-209e-47e5-96ac-fa1c3d3e61e2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef" returned: 0 in 0.573s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba
Sep 23 00:34:35 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf
Sep 23 00:34:35 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320 1073741824" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320
Sep 23 00:34:35 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653
Sep 23 00:34:35 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf
Sep 23 00:34:35 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" returned: 0 in 0.471s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba
Sep 23 00:34:35 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320" returned: 0 in 0.328s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.227s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336486879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60580fba-cdb2-4da8-8a03-5fb8ec682440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:33Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Creating volume 60580fba-cdb2-4da8-8a03-5fb8ec682440 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:35 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 1073741824
Sep 23 00:34:35 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13954f80-0a88-4ab2-8d81-9ed1088ee321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693a5af0-eeea-427c-ac93-67690a00d320', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3926ac06-30df-41f7-8e22-923ebdf6040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:35 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d.d9fd853c-989c-4601-af71-56e76f5d6653" returned: 0 in 0.351s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Volume volume-693a5af0-eeea-427c-ac93-67690a00d320 (693a5af0-eeea-427c-ac93-67690a00d320): created successfully
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3926ac06-30df-41f7-8e22-923ebdf6040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (5a816abe-3f46-4d7b-b8ad-795c0e646c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-d9fd853c-989c-4601-af71-56e76f5d6653" released by "_delete_snapshot" :: held 2.352s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c8a89153-ffa0-4089-a8ea-6973f10a4fe5 tempest-CreateVolumesFromImageTest-1057492786 None] Created volume successfully.
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-96994b23-5653-4c8b-ad02-a704b56bd90d" released by "delete_snapshot" :: held 2.387s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:35 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" returned: 0 in 0.303s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-ae0f03f5-499d-4aa5-87a6-ff46414b82bf" released by "delete_volume" :: held 0.856s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['88bdcd97-5609-4bfa-ad39-9c17eb0ca96f', '6bdab9ba-c8d2-4ee5-ad42-b94205583d93', 'dbdd9ed6-cba7-4fbf-bf06-6b2a3f943e50', '98a30bb3-3333-4734-b219-78d0d709450f', '128af440-7bf7-4ec4-bf43-5894f3baadaa'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:36 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Created reservations ['03f2ea22-1ec8-463c-a47e-a0f8a8a090e9', '84896499-85eb-4780-85c9-0cd68cbf96b7', '8b69b2e8-f8b9-4996-a311-20b5b3c3487b', '498f90d0-5c57-46d2-913a-9fdb3baa8331', '4d5bfabf-344e-4df5-8f42-0d3f51f12735'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef.b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" returned: 0 in 0.400s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-b3959fb8-b7d2-4e1a-adfd-039dad3d3cba" released by "_delete_snapshot" :: held 2.418s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-baea8f29-4e99-4b3a-aba2-1d620085a2ef" released by "delete_snapshot" :: held 2.459s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Delete snapshot completed successfully.
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a7fccd43-330b-469e-8a83-85cec43a07cf tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-d9fd853c-989c-4601-af71-56e76f5d6653-delete_snapshot" released by "delete_snapshot" :: held 2.820s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Created reservations ['1c013999-8fb4-4c1f-baf0-3a6c6d2daeca', 'c0f95ee3-e8cb-4b99-b5f0-33882be672c1', '73cc391a-e334-4380-ad78-ee2273fa6c76', '7afec1c6-3f43-4d2b-9272-3beb8441511e', '2ca3b9f7-a6d1-42ed-ab4f-66ce27223949'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:36 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:36 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Delete snapshot completed successfully.
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f11168cf-cd63-4adb-a917-7f7c3e2e9019 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-b3959fb8-b7d2-4e1a-adfd-039dad3d3cba-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:36 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 1073741824" returned: 0 in 0.665s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:36 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440
Sep 23 00:34:36 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-96994b23-5653-4c8b-ad02-a704b56bd90d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:36 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.312s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Deleted volume successfully.
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-96994b23-5653-4c8b-ad02-a704b56bd90d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-75003fc9-429a-471c-b7a7-8afd2ee3896b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-ae0f03f5-499d-4aa5-87a6-ff46414b82bf-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "cinder-quobyte-96994b23-5653-4c8b-ad02-a704b56bd90d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-96994b23-5653-4c8b-ad02-a704b56bd90d" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0941b-919d-4a5f-940a-c43ce76551d7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:36 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440" returned: 0 in 0.296s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760890484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6422f290-0fa4-4d05-a03f-7607b007e9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:34Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Creating volume 6422f290-0fa4-4d05-a03f-7607b007e9b9 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:36 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb650b97-7d06-4204-81cb-0eebb564b867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60580fba-cdb2-4da8-8a03-5fb8ec682440', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595a650f-8cfe-4f36-ba46-13865415f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:36 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 1073741824
Sep 23 00:34:36 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Volume volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 (60580fba-cdb2-4da8-8a03-5fb8ec682440): created successfully
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595a650f-8cfe-4f36-ba46-13865415f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (cae34220-c488-4f8b-b1f5-96761f5e0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:36 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d
Sep 23 00:34:36 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-21587a2f-d3e0-4969-981d-f600d4555c99 tempest-CreateVolumesFromImageTest-1057492786 None] Created volume successfully.
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-baea8f29-4e99-4b3a-aba2-1d620085a2ef-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-baea8f29-4e99-4b3a-aba2-1d620085a2ef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-quobyte-baea8f29-4e99-4b3a-aba2-1d620085a2ef" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-baea8f29-4e99-4b3a-aba2-1d620085a2ef" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcca9a4-1cce-49dd-bc36-639e75c0d744]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d" returned: 0 in 0.435s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-32bfc401-fdbd-4fed-88ab-29e0b5f7c259-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:37 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d
Sep 23 00:34:37 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-32bfc401-fdbd-4fed-88ab-29e0b5f7c259-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "cinder-quobyte-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" acquired by "delete_volume" :: waited 0.015s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:37 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef
Sep 23 00:34:37 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2331330-ce1b-4886-86f2-2c4894e2fea3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 1073741824" returned: 0 in 0.641s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9
Sep 23 00:34:37 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259
Sep 23 00:34:37 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-96994b23-5653-4c8b-ad02-a704b56bd90d" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-quobyte-96994b23-5653-4c8b-ad02-a704b56bd90d" released by "delete_volume" :: held 0.869s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Created reservations ['2ea63b76-2f70-410a-9bbb-78431d4bfaa7', 'ec06dfb6-bdd9-4fb4-8d06-cbd3459dadcc', '89066cf5-02fe-4f94-bf1c-82518531927e', '0289eb2d-2460-43ba-9ddd-b8e9ed7a03ed', '7ac16d11-d80f-4b83-8f7c-116fd57b1677'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:37 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef" returned: 0 in 0.539s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef
Sep 23 00:34:37 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9" returned: 0 in 0.360s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1658550082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea20220a-c31b-4759-bd1d-71979fcc3cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831f79713d4075b67d311c0de0aeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:35Z,use_quota=True,user_id='7ee0cda382ee4160a78bcbd43e15178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Creating volume ea20220a-c31b-4759-bd1d-71979fcc3cd8 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:37 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:37 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:37 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e983f-fc30-405c-a5e7-489307ad829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6422f290-0fa4-4d05-a03f-7607b007e9b9', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:37 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 1073741824
Sep 23 00:34:37 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bf2cf3-91d2-4cc0-b060-ca100f0360ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" returned: 0 in 0.565s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Volume volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 (6422f290-0fa4-4d05-a03f-7607b007e9b9): created successfully
Sep 23 00:34:37 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259
Sep 23 00:34:38 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bf2cf3-91d2-4cc0-b060-ca100f0360ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (a81020f9-4835-4323-9b5f-edcec93189db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7c4c7810-c0dc-41ff-b36b-928154de459e tempest-CreateVolumesFromImageTest-1057492786 None] Created volume successfully.
Sep 23 00:34:38 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.343s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:38 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Deleted volume successfully.
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-baea8f29-4e99-4b3a-aba2-1d620085a2ef" returned: 0 in 0.505s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-baea8f29-4e99-4b3a-aba2-1d620085a2ef" released by "delete_volume" :: held 1.149s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-29aab805-efc3-4008-86d1-3dfed8dc4849 tempest-CreateVolumesFromSnapshotTest-1378675053 None] Lock "cinder-96994b23-5653-4c8b-ad02-a704b56bd90d-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Created reservations ['6e2b057e-f4ee-4a04-8a15-4d291d9a05be', 'a752ee97-178e-4a8f-a163-c407cea14db2', 'b6f0c1b3-f392-40fa-abd9-3fc909c58a47', '0e6e9685-1143-4a1e-917f-087c391398c6', '27bc8134-6193-44ae-9054-46ae720fdf9a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:38 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" returned: 0 in 0.510s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:38 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:38 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-quobyte-32bfc401-fdbd-4fed-88ab-29e0b5f7c259" released by "delete_volume" :: held 1.137s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Created reservations ['77f83447-f838-4104-90d5-c4269fa92628', 'e4b5982e-231a-4247-b8df-3d687997ab1f', '8edb247a-e800-4ed5-95fa-7167cb83899d', 'f5aa7de0-ce34-4bc7-bd7b-f83af231356b', 'd19e88cc-14b7-4b4a-a250-b99b93a9b164'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:38 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 1073741824" returned: 0 in 0.821s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:38 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:38 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:38 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8
Sep 23 00:34:38 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:38 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.338s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Deleted volume successfully.
Sep 23 00:34:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-08bf7144-8ca2-4bfc-aa2a-771e75e25195 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-baea8f29-4e99-4b3a-aba2-1d620085a2ef-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:39 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Deleted volume successfully.
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e1e50dd9-b303-461b-aea2-7d3d57023c9b tempest-VolumeDependencyTests-1687647174 None] Lock "cinder-32bfc401-fdbd-4fed-88ab-29e0b5f7c259-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:39 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8" returned: 0 in 0.398s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92c5438-16de-4f62-a38c-62837892e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960c9c63-97fb-41a6-b6b3-52ed44ec56a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:39 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Volume volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 (ea20220a-c31b-4759-bd1d-71979fcc3cd8): created successfully
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960c9c63-97fb-41a6-b6b3-52ed44ec56a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Flow 'volume_create_manager' (f7c38952-e9f8-4274-ab87-0d31ae3bf1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b277ff53-f68b-4dd4-9888-09146bec21c4 tempest-CreateVolumesFromImageTest-1057492786 None] Created volume successfully.
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "cinder-quobyte-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97609dee-f24a-48c7-acc5-4a5d825a21c1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-ea20220a-c31b-4759-bd1d-71979fcc3cd8-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-ea20220a-c31b-4759-bd1d-71979fcc3cd8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-quobyte-ea20220a-c31b-4759-bd1d-71979fcc3cd8" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-ea20220a-c31b-4759-bd1d-71979fcc3cd8" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:39 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81
Sep 23 00:34:39 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0544e-3c09-46c6-be6b-ad3fe00f922b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8
Sep 23 00:34:39 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:40 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81" returned: 0 in 0.568s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:40 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:40 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:40 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81
Sep 23 00:34:40 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:40 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8" returned: 0 in 0.575s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:40 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8
Sep 23 00:34:40 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:40 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81" returned: 0 in 0.362s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.434s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-quobyte-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81" released by "delete_volume" :: held 1.007s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Created reservations ['2d69405f-52a6-40e8-a9c7-3238a9d152ce', '4c8bcfb1-d517-4dcc-99df-b3ef627fa80a', 'a1301c74-514a-4850-a66a-430a50751c9d', '5dc811e2-d3ad-4b7f-b7c8-7738138ee883', '4de4f628-d8ba-4a23-b67b-f3f89d4580a6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:40 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ea20220a-c31b-4759-bd1d-71979fcc3cd8" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-ea20220a-c31b-4759-bd1d-71979fcc3cd8" released by "delete_volume" :: held 1.095s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:40 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:40 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Created reservations ['00b8c049-fb30-4276-86a7-835d5c716490', '5bef6f6f-0ca0-438e-9baa-121092cc5fff', '984b1d96-abbf-40e5-ba7e-67ef2961e627', '181749aa-d932-487f-a67b-4e976f0b080c', '402667b1-288e-46cd-92b6-61956943a977'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:41 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:41 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:41 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Deleted volume successfully.
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4b27f44e-31ad-45bd-b713-f2d4b61a49c7 tempest-CinderUnicodeTest-1281867918 None] Lock "cinder-d8e058c6-3e6c-47f9-aee0-2d6d01d35b81-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:41 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.328s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Deleted volume successfully.
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-03a97136-69f0-4206-a5a3-7aff3a3b9b05 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-ea20220a-c31b-4759-bd1d-71979fcc3cd8-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-6422f290-0fa4-4d05-a03f-7607b007e9b9-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-6422f290-0fa4-4d05-a03f-7607b007e9b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-quobyte-6422f290-0fa4-4d05-a03f-7607b007e9b9" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-6422f290-0fa4-4d05-a03f-7607b007e9b9" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7565dfa-b64a-49c2-bcb3-5bf6875f946d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:42 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9
Sep 23 00:34:42 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:42 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:42 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9
Sep 23 00:34:42 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:42 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6422f290-0fa4-4d05-a03f-7607b007e9b9" returned: 0 in 0.412s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:42 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-6422f290-0fa4-4d05-a03f-7607b007e9b9" released by "delete_volume" :: held 0.914s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:42 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Created reservations ['3395582c-bd67-4b58-a544-676faed80dbe', 'd5a91c47-bfa2-46cf-b0e0-60609ed07e67', 'ebdc51a8-7efd-4519-bb60-8838e31531f5', 'dd7d1155-5793-49cd-b700-efe98c709dfd', '556a95ce-9c11-4a41-97d3-f7fbc64f5fc7'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-60580fba-cdb2-4da8-8a03-5fb8ec682440-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:43 devstack sudo[106148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:43 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-60580fba-cdb2-4da8-8a03-5fb8ec682440-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c1305e7c-d4b3-4f01-806c-be1ef413544b tempest-ProjectAdminTests-1204487 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87293) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-quobyte-60580fba-cdb2-4da8-8a03-5fb8ec682440" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-60580fba-cdb2-4da8-8a03-5fb8ec682440" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e349cd99-91ee-4a7a-bcbd-23fadc54760b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:43 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Deleted volume successfully.
Sep 23 00:34:43 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440
Sep 23 00:34:43 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6ce093a3-1b4c-4e03-8bcc-e5b983ddcf22 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-6422f290-0fa4-4d05-a03f-7607b007e9b9-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:43 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440" returned: 0 in 0.640s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:43 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440
Sep 23 00:34:43 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:44 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-60580fba-cdb2-4da8-8a03-5fb8ec682440" returned: 0 in 0.340s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-60580fba-cdb2-4da8-8a03-5fb8ec682440" released by "delete_volume" :: held 1.064s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Created reservations ['60721d7a-5169-454f-a9e4-a8af298756f5', '63157842-61e1-4081-a156-cc4669a19108', '9ee95166-ca7b-4496-bfce-5a8284887911', 'f0565885-82f7-4f79-a0d8-cfc18bf03fe9', 'b3ad11a2-1a53-489f-9dbf-ab83f1b866ba'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:44 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:44 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:44 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.284s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Deleted volume successfully.
Sep 23 00:34:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ab14c7f0-a42e-415e-80db-2c8b323c87a3 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-60580fba-cdb2-4da8-8a03-5fb8ec682440-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-693a5af0-eeea-427c-ac93-67690a00d320-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-693a5af0-eeea-427c-ac93-67690a00d320-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-quobyte-693a5af0-eeea-427c-ac93-67690a00d320" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-693a5af0-eeea-427c-ac93-67690a00d320" acquired by "delete_volume" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7c3c14-4183-4ba9-82d2-47aad40d8c0f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:45 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320
Sep 23 00:34:45 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:46 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320" returned: 0 in 0.503s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:46 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320
Sep 23 00:34:46 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:46 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-693a5af0-eeea-427c-ac93-67690a00d320" returned: 0 in 0.313s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-693a5af0-eeea-427c-ac93-67690a00d320" released by "delete_volume" :: held 0.885s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Created reservations ['79418c89-32d6-4124-98c3-b78924aac88a', '74facb5c-57c3-4a9a-87b6-5771d73cdca5', 'bf47f489-1ade-4644-bf3c-c4d1c2e53142', '3e2fc8b9-d446-4408-9546-ed5f183557ee', '784c812c-ec3b-4aa7-98ab-f9aa2bd12c21'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:46 devstack sudo[106171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:46 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-153d3c85-a070-4473-b77e-34973200c3b0-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-153d3c85-a070-4473-b77e-34973200c3b0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "cinder-quobyte-153d3c85-a070-4473-b77e-34973200c3b0" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-153d3c85-a070-4473-b77e-34973200c3b0" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e7f26-452c-43a7-a74f-b06362bf430b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:46 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:47 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0
Sep 23 00:34:47 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Deleted volume successfully.
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1bcd82bf-a3b0-4d9b-b498-95a98b06c9b8 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-693a5af0-eeea-427c-ac93-67690a00d320-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:47 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:47 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0
Sep 23 00:34:47 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:47 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-153d3c85-a070-4473-b77e-34973200c3b0" returned: 0 in 0.382s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-quobyte-153d3c85-a070-4473-b77e-34973200c3b0" released by "delete_volume" :: held 0.987s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:47 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Created reservations ['426c1e6e-4abf-4afc-a6ff-f955c9418e20', '08c56cf3-97c1-4e74-8930-7d4f189d97d3', '0fcb34ab-8581-4a35-a88e-d41909cc65d9', 'bb571fd5-3edf-401c-b6dd-1a5f932e4d37', '4d10e626-dcfa-4e0c-aaed-5487afe8d220'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:48 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:48 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:48 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.364s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Deleted volume successfully.
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-501824ca-fd0b-4adb-b0f3-2efbbebc7383 tempest-CreateVolumesFromImageTest-1057492786 None] Lock "cinder-153d3c85-a070-4473-b77e-34973200c3b0-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (7f600456-1f1f-4e8f-8ebf-37c0d0517ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c376ddb4-a7f5-4463-8ba5-ed82c511d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c376ddb4-a7f5-4463-8ba5-ed82c511d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115799264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a29bda9-80d1-43ad-802e-a64512fcad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:48Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145d7115-13e2-4d51-b02d-73de73e4422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145d7115-13e2-4d51-b02d-73de73e4422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c18c05-9926-44e4-a7e3-f67d1deb61bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c18c05-9926-44e4-a7e3-f67d1deb61bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a29bda9-80d1-43ad-802e-a64512fcad36', 'volume_name': 'volume-3a29bda9-80d1-43ad-802e-a64512fcad36', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c194be45-1338-444e-8d62-f5c2910c646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c194be45-1338-444e-8d62-f5c2910c646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0092a41-10a3-4f5a-8b06-74ec595d59d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Volume 3a29bda9-80d1-43ad-802e-a64512fcad36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a29bda9-80d1-43ad-802e-a64512fcad36', 'volume_size': 1}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115799264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a29bda9-80d1-43ad-802e-a64512fcad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:48Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Creating volume 3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:48 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:48 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 1073741824
Sep 23 00:34:48 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Flow 'volume_create_manager' (8caff814-c806-4d32-ae23-29015ce8d890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab78306-3885-4ec3-8595-0f8d359e179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab78306-3885-4ec3-8595-0f8d359e179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe8f6bc-dcbc-40a5-9b45-153bb4e95713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93337760794e448ba444d9e165179a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:49Z,use_quota=True,user_id='5480e546551942929480613d12e1d17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf9510b-2c53-4d1b-b064-05ff28cdbeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf9510b-2c53-4d1b-b064-05ff28cdbeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ce7737-9041-4efa-aafc-fb05fc9e4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:48 devstack cinder-volume[87293]: DEBUG cinder.image.glance [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Creating Keystone auth plugin from conf {{(pid=87293) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ce7737-9041-4efa-aafc-fb05fc9e4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fe8f6bc-dcbc-40a5-9b45-153bb4e95713', 'volume_name': 'volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713', 'volume_size': 1, 'image_id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd3791eb-8ec5-47aa-a311-522eca07db0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '230cb57a52bcd6efbf61a4cac00302a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93337760794e448ba444d9e165179a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8e99d19d93d3a3afab72fd510573a2dc18c2b486a2d85a9ed9501c1691f2528038947f4d1ab17b49f53272b1c666aa38ec76aebaa4185b56584d0737e0120f1', 'id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd3791eb-8ec5-47aa-a311-522eca07db0a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4bc2e70>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed0971a-b369-40bd-a557-d4ec348199a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed0971a-b369-40bd-a557-d4ec348199a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ff3fae-8042-4af0-b115-6a99bdf6d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Volume 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713', 'volume_size': 1, 'image_id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd3791eb-8ec5-47aa-a311-522eca07db0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '230cb57a52bcd6efbf61a4cac00302a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93337760794e448ba444d9e165179a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8e99d19d93d3a3afab72fd510573a2dc18c2b486a2d85a9ed9501c1691f2528038947f4d1ab17b49f53272b1c666aa38ec76aebaa4185b56584d0737e0120f1', 'id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd3791eb-8ec5-47aa-a311-522eca07db0a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4bc2e70>}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Trying to clone 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 from image fd3791eb-8ec5-47aa-a311-522eca07db0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fd3791eb-8ec5-47aa-a311-522eca07db0a', 'metadata': {}}]). {{(pid=87293) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 1073741824" returned: 0 in 0.686s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:49 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36
Sep 23 00:34:49 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:34:49 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d545de-3dd0-47a3-ae28-b06440e044c7]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:49 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD
Sep 23 00:34:49 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:49 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36" returned: 0 in 0.319s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0092a41-10a3-4f5a-8b06-74ec595d59d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a29bda9-80d1-43ad-802e-a64512fcad36', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4350583e-79f2-4956-8679-e745c9b15b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Volume volume-3a29bda9-80d1-43ad-802e-a64512fcad36 (3a29bda9-80d1-43ad-802e-a64512fcad36): created successfully
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4350583e-79f2-4956-8679-e745c9b15b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (7f600456-1f1f-4e8f-8ebf-37c0d0517ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c6542c91-481d-4fd8-a3bc-14204820aeec tempest-ProjectReaderTests-173410677 None] Created volume successfully.
Sep 23 00:34:50 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:50 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD
Sep 23 00:34:50 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:50 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Temporary image fd3791eb-8ec5-47aa-a311-522eca07db0a is fetched for user 5480e546551942929480613d12e1d17b. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3ad0e5-b922-4e77-94bf-ed42959201e0]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:50 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD
Sep 23 00:34:50 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Creating offline snapshot a4de41ca-a799-4fbb-b372-fde367aa9e58 of volume 3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7039b28-666b-412c-82ef-26f610265efd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:50 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD
Sep 23 00:34:51 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36
Sep 23 00:34:51 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:51 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36" returned: 0 in 0.498s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 1G
Sep 23 00:34:51 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 1G" returned: 0 in 0.487s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a29bda9-80d1-43ad-802e-a64512fcad36 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a29bda9-80d1-43ad-802e-a64512fcad36 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58
Sep 23 00:34:51 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (6453971b-64b7-4104-b778-c5440bed7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd7f929-baf7-42b8-bdb9-8c67f44398be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd7f929-baf7-42b8-bdb9-8c67f44398be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607447210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4514e91a-8cc2-481a-bc8b-ed8784076b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:52Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9582e6c2-aef5-4752-a631-9fa1accb151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9582e6c2-aef5-4752-a631-9fa1accb151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574a7137-1558-46bc-956f-42c248eb29a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574a7137-1558-46bc-956f-42c248eb29a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4514e91a-8cc2-481a-bc8b-ed8784076b75', 'volume_name': 'volume-4514e91a-8cc2-481a-bc8b-ed8784076b75', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ae4352-417a-4c75-9b05-02ec4eba4971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ae4352-417a-4c75-9b05-02ec4eba4971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc40211d-6404-48bc-9984-348a67103176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume 4514e91a-8cc2-481a-bc8b-ed8784076b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4514e91a-8cc2-481a-bc8b-ed8784076b75', 'volume_size': 1}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:52 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a29bda9-80d1-43ad-802e-a64512fcad36 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58" returned: 0 in 0.307s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:52 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 is being set with open permissions: ugo+rw
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:52 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58
Sep 23 00:34:52 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:52 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58" returned: 0 in 0.266s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:52 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info
Sep 23 00:34:52 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:52 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info" returned: 0 in 0.287s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:52 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info is being set with open permissions: ugo+rw
Sep 23 00:34:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:52 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info
Sep 23 00:34:52 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:53 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.info" returned: 0 in 0.260s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe8f6bc-dcbc-40a5-9b45-153bb4e95713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93337760794e448ba444d9e165179a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:49Z,use_quota=True,user_id='5480e546551942929480613d12e1d17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Creating volume 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:53 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:53 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 1073741824
Sep 23 00:34:53 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5828efb6-5ac3-4c41-bbcb-851806b05208 tempest-ProjectReaderTests-173410677 None] Create snapshot completed successfully
Sep 23 00:34:53 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 1073741824" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:53 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713
Sep 23 00:34:53 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:53 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" returned: 0 in 0.252s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607447210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4514e91a-8cc2-481a-bc8b-ed8784076b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:52Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Creating volume 4514e91a-8cc2-481a-bc8b-ed8784076b75 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:53 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:53 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 1073741824
Sep 23 00:34:53 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:53 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Attempting download of fd3791eb-8ec5-47aa-a311-522eca07db0a ((None, [{'url': 'file:///opt/stack/data/glance/images/fd3791eb-8ec5-47aa-a311-522eca07db0a', 'metadata': {}}])) to volume 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a3f3d-fdbe-44c1-9850-8872c2079319]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q
Sep 23 00:34:54 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-a4de41ca-a799-4fbb-b372-fde367aa9e58-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Lock "cinder-a4de41ca-a799-4fbb-b372-fde367aa9e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-3a29bda9-80d1-43ad-802e-a64512fcad36" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3a29bda9-80d1-43ad-802e-a64512fcad36" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-a4de41ca-a799-4fbb-b372-fde367aa9e58" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-a4de41ca-a799-4fbb-b372-fde367aa9e58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Deleting offline snapshot a4de41ca-a799-4fbb-b372-fde367aa9e58 of volume 3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] snapshot_file for this snap is: volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9295b-444b-4480-ad73-ed637dce9c8e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q" returned: 0 in 0.450s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 1073741824" returned: 0 in 0.597s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:54 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58
Sep 23 00:34:54 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75
Sep 23 00:34:54 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:54 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q
Sep 23 00:34:54 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:54 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58" returned: 0 in 0.469s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a29bda9-80d1-43ad-802e-a64512fcad36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:54 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75" returned: 0 in 0.364s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954e93c-2546-496d-97cc-039f2456a672]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q" returned: 1 in 0.480s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd3791eb-8ec5-47aa-a311-522eca07db0a_8e8p9z0q' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc40211d-6404-48bc-9984-348a67103176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4514e91a-8cc2-481a-bc8b-ed8784076b75', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6c7454-e8d2-4d2d-bac2-6d89c512ab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4517e4a1-93cc-4672-bcd5-e30c312dcb98]: (4, 'raw') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 (4514e91a-8cc2-481a-bc8b-ed8784076b75): created successfully
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6c7454-e8d2-4d2d-bac2-6d89c512ab7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:54 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (6453971b-64b7-4104-b778-c5440bed7039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:55 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dafd8d17-a8c4-4263-a054-68a8e36627c2 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created volume successfully.
Sep 23 00:34:55 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36
Sep 23 00:34:55 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:55 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD
Sep 23 00:34:55 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:55 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:55 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36" returned: 0 in 0.484s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:55 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58
Sep 23 00:34:55 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:55 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD
Sep 23 00:34:55 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:55 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] fd3791eb-8ec5-47aa-a311-522eca07db0a was raw, converting to qcow2 {{(pid=87293) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:55 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713
Sep 23 00:34:55 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:55 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58" returned: 0 in 0.571s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:56 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58
Sep 23 00:34:56 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (f5932b70-12d6-484f-b00a-ba1ba6490d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b570b36a-48e2-495e-a429-c3bb412669e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b570b36a-48e2-495e-a429-c3bb412669e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-76303623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b74b067-91dd-45ee-911f-3faa2af1849e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:56Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd9af4e-3d77-48c5-85ec-aff825eadbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd9af4e-3d77-48c5-85ec-aff825eadbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff59efe0-f78d-44e5-ad44-73e52897b7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff59efe0-f78d-44e5-ad44-73e52897b7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b74b067-91dd-45ee-911f-3faa2af1849e', 'volume_name': 'volume-1b74b067-91dd-45ee-911f-3faa2af1849e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f6ee5b-7cf2-4b19-9472-83f9568a9699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f6ee5b-7cf2-4b19-9472-83f9568a9699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e340940c-175f-4b78-8592-6a6e7899b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume 1b74b067-91dd-45ee-911f-3faa2af1849e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b74b067-91dd-45ee-911f-3faa2af1849e', 'volume_size': 1}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-76303623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b74b067-91dd-45ee-911f-3faa2af1849e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:56Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Creating volume 1b74b067-91dd-45ee-911f-3faa2af1849e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:56 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:56 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e 1073741824
Sep 23 00:34:56 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:56 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (c0343f50-a629-4b63-8d67-3fe83d9fad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9625b9d6-8fcf-4edd-a126-ba10c57ba22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36.a4de41ca-a799-4fbb-b372-fde367aa9e58" returned: 0 in 0.629s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-a4de41ca-a799-4fbb-b372-fde367aa9e58" released by "_delete_snapshot" :: held 2.337s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9625b9d6-8fcf-4edd-a126-ba10c57ba22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485027160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bafad346-b2d4-4a91-a100-03f7503a8dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:56Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917fcbf0-3f33-45df-83d2-5f4fa3b2238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917fcbf0-3f33-45df-83d2-5f4fa3b2238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7598556e-e446-41e5-9ee7-edcfd2c869dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7598556e-e446-41e5-9ee7-edcfd2c869dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bafad346-b2d4-4a91-a100-03f7503a8dae', 'volume_name': 'volume-bafad346-b2d4-4a91-a100-03f7503a8dae', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d443102-d4db-4129-987d-fb8ca8d9e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d443102-d4db-4129-987d-fb8ca8d9e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797b2d6b-e793-4ea3-9273-52fb48b63772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:56 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume bafad346-b2d4-4a91-a100-03f7503a8dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bafad346-b2d4-4a91-a100-03f7503a8dae', 'volume_size': 1}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3a29bda9-80d1-43ad-802e-a64512fcad36" released by "delete_snapshot" :: held 2.509s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" returned: 0 in 0.936s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fd3791eb-8ec5-47aa-a311-522eca07db0a_zb23ngfldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:34:56 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:34:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:56 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 1G
Sep 23 00:34:56 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Created reservations ['701fd62d-e115-49f4-905d-27c3c4179f70', '865e4e26-52f4-4742-986a-28ba4afe7f37', 'da9be86e-a76f-4fa6-a329-cc1c6553e0ac', '4690afad-35b9-42d7-8576-03321354bd9e', 'd9414b2a-3abb-46f4-bf03-0e3cdcdc6584'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:57 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e 1073741824" returned: 0 in 0.864s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Delete snapshot completed successfully.
Sep 23 00:34:57 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e
Sep 23 00:34:57 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-afd067d2-f070-40f8-a48f-dbd9f87228b6 tempest-ProjectReaderTests-173410677 None] Lock "cinder-a4de41ca-a799-4fbb-b372-fde367aa9e58-delete_snapshot" released by "delete_snapshot" :: held 2.938s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (b98948c1-78c2-4618-8e06-b2d6db3e183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a080e7a-23df-45b5-a575-131c539bf423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a080e7a-23df-45b5-a575-131c539bf423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1991624357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:57Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32aaf38f-8fd6-40da-8bea-8bcb6d70612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32aaf38f-8fd6-40da-8bea-8bcb6d70612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c6e12-a312-4dc2-a904-d8732b246662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c6e12-a312-4dc2-a904-d8732b246662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f', 'volume_name': 'volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51223eca-e8f9-443e-a291-bd800b0d0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51223eca-e8f9-443e-a291-bd800b0d0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436071ec-a3dd-4eda-a9e6-46fd2dad2f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f', 'volume_size': 1}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:57 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 1G" returned: 0 in 0.624s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Downloaded image fd3791eb-8ec5-47aa-a311-522eca07db0a ((None, [{'url': 'file:///opt/stack/data/glance/images/fd3791eb-8ec5-47aa-a311-522eca07db0a', 'metadata': {}}])) to volume 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 successfully. {{(pid=87293) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Temporary image fd3791eb-8ec5-47aa-a311-522eca07db0a for user 5480e546551942929480613d12e1d17b is deleted. {{(pid=87293) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.volume_utils [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Marking volume 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 as bootable. {{(pid=87293) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Copying metadata from image fd3791eb-8ec5-47aa-a311-522eca07db0a to 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713. {{(pid=87293) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Creating volume glance metadata for volume 6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 backed by image fd3791eb-8ec5-47aa-a311-522eca07db0a with: {'image_id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '230cb57a52bcd6efbf61a4cac00302a5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87293) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-3a29bda9-80d1-43ad-802e-a64512fcad36-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Lock "cinder-3a29bda9-80d1-43ad-802e-a64512fcad36-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ff3fae-8042-4af0-b115-6a99bdf6d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713', 'volume_size': 1, 'image_id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd3791eb-8ec5-47aa-a311-522eca07db0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '230cb57a52bcd6efbf61a4cac00302a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93337760794e448ba444d9e165179a24', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8e99d19d93d3a3afab72fd510573a2dc18c2b486a2d85a9ed9501c1691f2528038947f4d1ab17b49f53272b1c666aa38ec76aebaa4185b56584d0737e0120f1', 'id': 'fd3791eb-8ec5-47aa-a311-522eca07db0a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd3791eb-8ec5-47aa-a311-522eca07db0a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74afd4bc2e70>}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ead802-ac94-48bd-bc94-18129e585823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Volume volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 (6fe8f6bc-dcbc-40a5-9b45-153bb4e95713): created successfully
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ead802-ac94-48bd-bc94-18129e585823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Flow 'volume_create_manager' (8caff814-c806-4d32-ae23-29015ce8d890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e" returned: 0 in 0.599s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485027160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bafad346-b2d4-4a91-a100-03f7503a8dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:56Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Creating volume bafad346-b2d4-4a91-a100-03f7503a8dae {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:57 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:57 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7890e017-bf41-4c67-b08a-d9d66c2b10e0 tempest-VolumeImageDependencyTests-1635589656 None] Created volume successfully.
Sep 23 00:34:57 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae 1073741824
Sep 23 00:34:57 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-3a29bda9-80d1-43ad-802e-a64512fcad36" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e340940c-175f-4b78-8592-6a6e7899b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b74b067-91dd-45ee-911f-3faa2af1849e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9785aee2-7029-4331-947b-93c934aa6ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3a29bda9-80d1-43ad-802e-a64512fcad36" acquired by "delete_volume" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume volume-1b74b067-91dd-45ee-911f-3faa2af1849e (1b74b067-91dd-45ee-911f-3faa2af1849e): created successfully
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9785aee2-7029-4331-947b-93c934aa6ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (f5932b70-12d6-484f-b00a-ba1ba6490d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b02e50-3a95-4ea2-8b71-bd57a199eb5f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2291c9f1-ea0a-4751-9e59-7cfeddb90a11 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created volume successfully.
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (867e2b80-dac8-487b-a967-db3dfbb5a3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cffe980-d4d1-4387-8577-19c2f5ef29ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cffe980-d4d1-4387-8577-19c2f5ef29ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966553520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cabe712-572f-40fa-bb07-e259322eac8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:58Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36
Sep 23 00:34:58 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde62909-81b7-41da-89ae-77e1db673764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde62909-81b7-41da-89ae-77e1db673764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd889fd-fcda-442d-afd4-3de166f209bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd889fd-fcda-442d-afd4-3de166f209bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cabe712-572f-40fa-bb07-e259322eac8f', 'volume_name': 'volume-0cabe712-572f-40fa-bb07-e259322eac8f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9be8d9f-448b-4f1a-a304-3ae352815377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9be8d9f-448b-4f1a-a304-3ae352815377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b1551a-5d55-4c84-80ca-c39b71545556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume 0cabe712-572f-40fa-bb07-e259322eac8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cabe712-572f-40fa-bb07-e259322eac8f', 'volume_size': 1}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Acquiring lock "cinder-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Lock "cinder-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Acquiring lock "cinder-quobyte-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Lock "cinder-quobyte-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:58 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae 1073741824" returned: 0 in 0.914s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ff436-e713-4795-9be5-aeebd1eb35a8]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:58 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36" returned: 0 in 0.745s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:58 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36
Sep 23 00:34:58 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (62532cdd-290f-44eb-98fb-c10cdf96039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d40607-176b-4529-a651-025d5862e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:58 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713
Sep 23 00:34:58 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:58 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae
Sep 23 00:34:58 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d40607-176b-4529-a651-025d5862e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359505851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cba0dad-9073-4d33-8c25-5da7659b5a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:59Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce441225-a41f-4843-a7d2-f5026d38ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce441225-a41f-4843-a7d2-f5026d38ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad303d2-6ba6-43db-96c2-fed79f10ddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad303d2-6ba6-43db-96c2-fed79f10ddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cba0dad-9073-4d33-8c25-5da7659b5a53', 'volume_name': 'volume-4cba0dad-9073-4d33-8c25-5da7659b5a53', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:58 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c399ce7-0604-4d7e-97d7-452ce24258eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c399ce7-0604-4d7e-97d7-452ce24258eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f728002c-994d-4215-a154-242dc2625572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume 4cba0dad-9073-4d33-8c25-5da7659b5a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cba0dad-9073-4d33-8c25-5da7659b5a53', 'volume_size': 1}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:59 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3a29bda9-80d1-43ad-802e-a64512fcad36" returned: 0 in 0.339s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3a29bda9-80d1-43ad-802e-a64512fcad36" released by "delete_volume" :: held 1.211s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:59 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae" returned: 0 in 0.360s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.870s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1991624357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:57Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Creating volume ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:59 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:59 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" returned: 0 in 0.565s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:59 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f 1073741824
Sep 23 00:34:59 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797b2d6b-e793-4ea3-9273-52fb48b63772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bafad346-b2d4-4a91-a100-03f7503a8dae', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4e31a8-eefa-416c-a853-194f62d12904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:59 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713
Sep 23 00:34:59 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Created reservations ['f0639018-003f-4311-8019-e25fb7e0171f', 'bd2ec878-1326-406a-9626-91027f881dd1', 'c662697a-563d-4a97-838b-07e4426c1f0d', '29ea5433-dd81-43f8-938d-128720b5d7bd', '89c2fed0-4351-4cee-8944-546e63224a7c'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:59 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume volume-bafad346-b2d4-4a91-a100-03f7503a8dae (bafad346-b2d4-4a91-a100-03f7503a8dae): created successfully
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4e31a8-eefa-416c-a853-194f62d12904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (c0343f50-a629-4b63-8d67-3fe83d9fad01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-c9b1ec1c-08fb-4b0b-9415-03cf4f68727b tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created volume successfully.
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:59 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:34:59 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:59 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Lock "cinder-quobyte-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713" released by "delete_volume" :: held 0.997s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Created reservations ['0b8151d5-2ba7-4785-bad1-e3127db0589d', '0edde4fe-e114-4d12-88ca-c44c9a3652d1', '24f9f279-5701-4d13-8d9e-b1d26d8a1733', '527b0a9a-52ff-4bcf-a05e-34ddb410df13', 'cd94870d-d109-44e8-99b6-06c4d1e7fa82'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:34:59 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.367s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:59 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Deleted volume successfully.
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9e109207-f49c-4a1b-aa5c-42891e993929 tempest-ProjectReaderTests-173410677 None] Lock "cinder-3a29bda9-80d1-43ad-802e-a64512fcad36-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:59 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f 1073741824" returned: 0 in 0.693s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:00 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:00 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:00 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f
Sep 23 00:35:00 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:00 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.284s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Deleted volume successfully.
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d88bcd4b-ccb8-4e8c-8a3b-8846e908655e tempest-VolumeImageDependencyTests-1635589656 None] Lock "cinder-6fe8f6bc-dcbc-40a5-9b45-153bb4e95713-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:00 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f" returned: 0 in 0.280s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966553520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cabe712-572f-40fa-bb07-e259322eac8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:58Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Creating volume 0cabe712-572f-40fa-bb07-e259322eac8f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:00 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:00 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f 1073741824
Sep 23 00:35:00 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436071ec-a3dd-4eda-a9e6-46fd2dad2f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96745bcc-99f4-4f1d-a5a5-1625ac28a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:00 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f (ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f): created successfully
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96745bcc-99f4-4f1d-a5a5-1625ac28a491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (b98948c1-78c2-4618-8e06-b2d6db3e183e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:00 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9930d16b-102a-4d43-b4f5-3b87c6236244 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created volume successfully.
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (3048a3b9-4c6d-4c9d-8069-404ad69f1e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656bef0e-7644-4a87-9b29-efdc88723637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656bef0e-7644-4a87-9b29-efdc88723637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1607228784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3270c14b-5f81-4c88-86dc-5ce9beb12f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:01Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:00 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c52ff10-824c-4fa0-aed0-9cb26b6c87ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c52ff10-824c-4fa0-aed0-9cb26b6c87ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9ef523-cc7e-4509-8303-f8d2ea72de59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9ef523-cc7e-4509-8303-f8d2ea72de59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3270c14b-5f81-4c88-86dc-5ce9beb12f2c', 'volume_name': 'volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b873bfd-8242-482b-9f78-61814ac6d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b873bfd-8242-482b-9f78-61814ac6d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8c749c-465c-4b9b-8791-d98daa2d80a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:01 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Volume 3270c14b-5f81-4c88-86dc-5ce9beb12f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c', 'volume_size': 1}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:01 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f 1073741824" returned: 0 in 0.756s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=278,cinder:SELECT=201,cinder:INSERT=80,cinder:DELETE=20 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:01 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f
Sep 23 00:35:01 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:01 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f" returned: 0 in 0.335s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.746s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359505851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cba0dad-9073-4d33-8c25-5da7659b5a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b9d48bf2194d15962b5a20d5376d21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:59Z,use_quota=True,user_id='f9ec44e3fd9d4eb983c9b149dcb974ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Creating volume 4cba0dad-9073-4d33-8c25-5da7659b5a53 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:01 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:01 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 1073741824
Sep 23 00:35:01 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b1551a-5d55-4c84-80ca-c39b71545556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cabe712-572f-40fa-bb07-e259322eac8f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e20353-82c6-465f-87f9-b8305a87180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=214,cinder:UPDATE=255,cinder:INSERT=76,cinder:DELETE=24 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:35:01 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume volume-0cabe712-572f-40fa-bb07-e259322eac8f (0cabe712-572f-40fa-bb07-e259322eac8f): created successfully
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e20353-82c6-465f-87f9-b8305a87180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:01 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (867e2b80-dac8-487b-a967-db3dfbb5a3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d1c22a1d-6828-4cbc-8d89-2279c248b9bf tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created volume successfully.
Sep 23 00:35:02 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 1073741824" returned: 0 in 0.658s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:02 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53
Sep 23 00:35:02 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:02 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53" returned: 0 in 0.309s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1607228784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3270c14b-5f81-4c88-86dc-5ce9beb12f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:01Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Creating volume 3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:02 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:02 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c 1073741824
Sep 23 00:35:02 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f728002c-994d-4215-a154-242dc2625572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cba0dad-9073-4d33-8c25-5da7659b5a53', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3457fde1-4f53-4747-a202-8976c7700a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:02 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Volume volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 (4cba0dad-9073-4d33-8c25-5da7659b5a53): created successfully
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3457fde1-4f53-4747-a202-8976c7700a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:02 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Flow 'volume_create_manager' (62532cdd-290f-44eb-98fb-c10cdf96039f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:02 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-887dd067-8995-4841-9873-931bf9ea4849 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created volume successfully.
Sep 23 00:35:03 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c 1073741824" returned: 0 in 0.592s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:03 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c
Sep 23 00:35:03 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-4cba0dad-9073-4d33-8c25-5da7659b5a53-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-4cba0dad-9073-4d33-8c25-5da7659b5a53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-quobyte-4cba0dad-9073-4d33-8c25-5da7659b5a53" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-4cba0dad-9073-4d33-8c25-5da7659b5a53" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8e2570-c404-47ec-8df0-07ddb4b04fa1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:03 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:03 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53
Sep 23 00:35:03 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8c749c-465c-4b9b-8791-d98daa2d80a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af7093d-c988-49df-9f93-af9582db01f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:03 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Volume volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c (3270c14b-5f81-4c88-86dc-5ce9beb12f2c): created successfully
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af7093d-c988-49df-9f93-af9582db01f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:03 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (3048a3b9-4c6d-4c9d-8069-404ad69f1e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-84ee9b82-3b2b-4001-89d7-c80ad635ee1a tempest-ProjectReaderTests-173410677 None] Created volume successfully.
Sep 23 00:35:04 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53" returned: 0 in 0.538s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:04 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53
Sep 23 00:35:04 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4cba0dad-9073-4d33-8c25-5da7659b5a53" returned: 0 in 0.286s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-4cba0dad-9073-4d33-8c25-5da7659b5a53" released by "delete_volume" :: held 0.897s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created reservations ['3ae08fbb-3d6f-4090-ba1a-eb0251b555f5', '6ea8ba0d-73c5-4400-97f7-f24f6ac5e81f', 'ae2d9bf1-e8a8-4b3f-935c-4682dd55eb34', '18305c40-fbda-48b3-ba49-7ec472124ec0', 'db7a9aba-6167-444c-8fcd-6b8427cf58c5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:04 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:04 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-0cabe712-572f-40fa-bb07-e259322eac8f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-0cabe712-572f-40fa-bb07-e259322eac8f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-quobyte-0cabe712-572f-40fa-bb07-e259322eac8f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-0cabe712-572f-40fa-bb07-e259322eac8f" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0af6815-1cab-4e5d-a07a-fd6a8022a34f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.341s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:05 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Deleted volume successfully.
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e4d791e2-6600-446b-9bdf-b4644bd6ddad tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-4cba0dad-9073-4d33-8c25-5da7659b5a53-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:05 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f
Sep 23 00:35:05 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Creating offline snapshot d950c336-dffb-4079-929d-a36df5175424 of volume 3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[677dd06f-a961-4b5b-91d1-d926020572d2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f" returned: 0 in 0.590s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f
Sep 23 00:35:05 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c
Sep 23 00:35:05 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0cabe712-572f-40fa-bb07-e259322eac8f" returned: 0 in 0.303s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-0cabe712-572f-40fa-bb07-e259322eac8f" released by "delete_volume" :: held 0.956s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created reservations ['a92cd90e-1c1f-41ef-a38f-6a7715e93ba6', '79a6dd2f-da7a-455c-a451-6b7a27a0d1e0', '23a523e2-e826-4ca4-8218-79211a1ff41b', '61731f52-be06-4b62-b02e-a87c70ffc244', '47fd9421-9b34-4b9b-a7fb-c5a20da7fa58'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:06 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:06 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 1G
Sep 23 00:35:06 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:06 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:06 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:06 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.298s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:06 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Deleted volume successfully.
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e5fc7b63-e1c2-42fb-8332-a86b46177b89 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-0cabe712-572f-40fa-bb07-e259322eac8f-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:06 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 1G" returned: 0 in 0.528s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:06 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424
Sep 23 00:35:06 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:06 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424" returned: 0 in 0.326s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:06 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 is being set with open permissions: ugo+rw
Sep 23 00:35:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:06 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424
Sep 23 00:35:06 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-quobyte-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:07 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424" returned: 0 in 0.327s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8511bf7-7e85-4af3-9b87-3796f7574627]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info
Sep 23 00:35:07 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f
Sep 23 00:35:07 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info" returned: 0 in 0.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info is being set with open permissions: ugo+rw
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info
Sep 23 00:35:07 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f" returned: 0 in 0.484s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f
Sep 23 00:35:07 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.info" returned: 0 in 0.362s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:08 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-15bc8c6d-8404-475d-a292-ce249e466830 tempest-ProjectReaderTests-173410677 None] Create snapshot completed successfully
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f" returned: 0 in 0.365s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f" released by "delete_volume" :: held 0.918s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created reservations ['26a07fca-db81-4832-a56b-b2220bcb6f84', '734b5934-7588-49f9-b3fb-d21825554308', '1745b5bb-04d9-4126-8fdb-b9707800698a', 'd3d7abb0-b9b5-4ace-85b4-72944d13b4b6', '8660f288-68f4-4175-acf5-40cd022ee8f8'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:08 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:08 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.292s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Deleted volume successfully.
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-71647ca3-e192-4ab8-a80c-8a867229c126 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-ddc1f754-c8e4-4b76-a23d-9f7d2afd5b3f-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-d950c336-dffb-4079-929d-a36df5175424-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Lock "cinder-d950c336-dffb-4079-929d-a36df5175424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-d950c336-dffb-4079-929d-a36df5175424" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-d950c336-dffb-4079-929d-a36df5175424" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Deleting offline snapshot d950c336-dffb-4079-929d-a36df5175424 of volume 3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] snapshot_file for this snap is: volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d657553-a32b-4638-9f6f-245587eb3ae1]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424
Sep 23 00:35:09 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424" returned: 0 in 0.439s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861c285-05ee-4910-a729-8bff6593878f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-bafad346-b2d4-4a91-a100-03f7503a8dae-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-bafad346-b2d4-4a91-a100-03f7503a8dae-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-quobyte-bafad346-b2d4-4a91-a100-03f7503a8dae" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:09 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c
Sep 23 00:35:09 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-bafad346-b2d4-4a91-a100-03f7503a8dae" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ad79e-8d97-4460-a780-12c65d3fb65e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae
Sep 23 00:35:09 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" returned: 0 in 0.568s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424
Sep 23 00:35:09 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:10 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae" returned: 0 in 0.583s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:10 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae
Sep 23 00:35:10 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:10 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:10 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424
Sep 23 00:35:10 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:10 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-bafad346-b2d4-4a91-a100-03f7503a8dae" returned: 0 in 0.346s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-bafad346-b2d4-4a91-a100-03f7503a8dae" released by "delete_volume" :: held 1.016s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created reservations ['cb7de04d-cb11-4d68-b5b6-c7f6a7ea3585', '5b327ca9-aaae-4456-8075-1f06be17f777', '09bbff71-682f-451b-9166-60e40e55d82b', 'c213f1d6-3a76-42ef-a46a-a3ca7f17ccd2', '6f3bbf6e-3654-4b66-b3af-fdbb48d7973d'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:10 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c.d950c336-dffb-4079-929d-a36df5175424" returned: 0 in 0.329s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-d950c336-dffb-4079-929d-a36df5175424" released by "_delete_snapshot" :: held 1.962s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" released by "delete_snapshot" :: held 1.994s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:10 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Created reservations ['35de6fa6-2841-4794-8325-e4952420451b', 'cc7caa79-85f5-4d6d-acf9-8f1beea19133', 'd32a5625-d323-4c2d-8aba-52cb5bc9fa3e', '29554284-db30-4d19-bfc6-498fe99aa685', '1e39f9c8-1470-4fea-ad89-d3556a9618ae'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:10 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:10 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Delete snapshot completed successfully.
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d81aaa1-e070-4f4f-ae7c-b86a6b7188e5 tempest-ProjectReaderTests-173410677 None] Lock "cinder-d950c336-dffb-4079-929d-a36df5175424-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:11 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.392s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Deleted volume successfully.
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-e92a8324-f28e-4f5f-93bb-1a7556fdeb51 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-bafad346-b2d4-4a91-a100-03f7503a8dae-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-1b74b067-91dd-45ee-911f-3faa2af1849e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-1b74b067-91dd-45ee-911f-3faa2af1849e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-quobyte-1b74b067-91dd-45ee-911f-3faa2af1849e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-1b74b067-91dd-45ee-911f-3faa2af1849e" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[556588ff-f3a5-4c5f-98b7-963e89a77d5a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (dfbab18d-92c3-4dab-85da-b01ba91580a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df128bf-e824-41db-8d14-13fe2e2680ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-3270c14b-5f81-4c88-86dc-5ce9beb12f2c-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df128bf-e824-41db-8d14-13fe2e2680ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350884725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67f0236-062b-4952-bc18-0197b848ff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:12Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2e9b76-f1e8-43dd-9b9e-183daf5889fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2e9b76-f1e8-43dd-9b9e-183daf5889fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437d92ed-d180-4b1d-a8c6-96df27c52252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437d92ed-d180-4b1d-a8c6-96df27c52252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67f0236-062b-4952-bc18-0197b848ff09', 'volume_name': 'volume-c67f0236-062b-4952-bc18-0197b848ff09', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4b5e14-8b4a-48b6-81e5-a0e7bf0b88c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4b5e14-8b4a-48b6-81e5-a0e7bf0b88c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d560fee4-d8e4-4db8-9d23-28fba25e79f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Volume c67f0236-062b-4952-bc18-0197b848ff09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67f0236-062b-4952-bc18-0197b848ff09', 'volume_size': 1}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350884725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67f0236-062b-4952-bc18-0197b848ff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:12Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Creating volume c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:12 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e
Sep 23 00:35:12 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:12 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Lock "cinder-3270c14b-5f81-4c88-86dc-5ce9beb12f2c-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:12 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 1073741824
Sep 23 00:35:12 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e8a6e-5d14-40f8-8a49-fd4786c6a47e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e" returned: 0 in 0.598s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e
Sep 23 00:35:12 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c
Sep 23 00:35:12 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Flow 'volume_create_manager' (a32f69c2-fd33-4ec7-951f-36374ca4cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e98441a-935e-40b6-904a-7588867f9399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e98441a-935e-40b6-904a-7588867f9399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665467306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c93e9c-69f9-4f38-b9ec-f304b7ce09de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9971dd069202481db8bd46b60d44f104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:13Z,use_quota=True,user_id='bc3acacde7fc4c64a44202578411c550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5aa908-ae02-40d1-b4d0-53cb34afd5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5aa908-ae02-40d1-b4d0-53cb34afd5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153d4564-5d0d-4c04-a296-c5f3877e4569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153d4564-5d0d-4c04-a296-c5f3877e4569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c93e9c-69f9-4f38-b9ec-f304b7ce09de', 'volume_name': 'volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf2f336-319e-400f-be5f-91621ad8a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf2f336-319e-400f-be5f-91621ad8a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebfa372-e377-4b04-a6ae-66d8ecc2aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:12 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Volume 17c93e9c-69f9-4f38-b9ec-f304b7ce09de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de', 'volume_size': 1}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 1073741824" returned: 0 in 0.675s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09
Sep 23 00:35:12 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1b74b067-91dd-45ee-911f-3faa2af1849e" returned: 0 in 0.409s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-1b74b067-91dd-45ee-911f-3faa2af1849e" released by "delete_volume" :: held 1.099s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" returned: 0 in 0.695s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:13 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c
Sep 23 00:35:13 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created reservations ['9dce8cf4-c65b-4e2f-9e3f-d8e2a3446bfe', '65b0afe2-2758-472f-8a7f-20b5e20f5be9', 'ecc54921-7e82-45b2-ac56-ca6acaa89908', 'fe9ce4c0-6a13-4330-81fa-b14d7ea437dd', '8148f8a3-a19a-456c-b0ff-2fbed9e9e80d'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:13 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09" returned: 0 in 0.356s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:13 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:13 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665467306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c93e9c-69f9-4f38-b9ec-f304b7ce09de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9971dd069202481db8bd46b60d44f104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:13Z,use_quota=True,user_id='bc3acacde7fc4c64a44202578411c550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Creating volume 17c93e9c-69f9-4f38-b9ec-f304b7ce09de {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:13 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d560fee4-d8e4-4db8-9d23-28fba25e79f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67f0236-062b-4952-bc18-0197b848ff09', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa296d7-934e-46f8-a23d-162cec714bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:13 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de 1073741824
Sep 23 00:35:13 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:13 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Volume volume-c67f0236-062b-4952-bc18-0197b848ff09 (c67f0236-062b-4952-bc18-0197b848ff09): created successfully
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa296d7-934e-46f8-a23d-162cec714bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (dfbab18d-92c3-4dab-85da-b01ba91580a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:13 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" returned: 0 in 0.295s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-53760b0d-1af4-47be-875c-b44c13910760 tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-3270c14b-5f81-4c88-86dc-5ce9beb12f2c" released by "delete_volume" :: held 1.086s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Created reservations ['0c385a14-4fb8-4022-9bc7-5a863d8a69d5', '40d1e44c-86da-4dee-aa21-5074bddff978', 'e864134a-3550-480e-b114-0633674685cf', 'dbf0db6f-be42-4a05-85d7-3ec712bb2f09', 'df090231-b29f-4fa1-81a4-b5650528d62f'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:13 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.306s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Deleted volume successfully.
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-80426371-1943-4fdd-8501-99c59119cd65 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-1b74b067-91dd-45ee-911f-3faa2af1849e-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:13 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:13 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de 1073741824" returned: 0 in 0.550s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:13 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.286s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Deleted volume successfully.
Sep 23 00:35:13 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de
Sep 23 00:35:13 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ae5d78b9-9279-4ff7-9a07-d6f52f310a06 tempest-ProjectReaderTests-173410677 None] Lock "cinder-3270c14b-5f81-4c88-86dc-5ce9beb12f2c-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:14 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de" returned: 0 in 0.303s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-4514e91a-8cc2-481a-bc8b-ed8784076b75-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebfa372-e377-4b04-a6ae-66d8ecc2aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e01a4f-ad43-44b3-bb17-e187b66e5a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-4514e91a-8cc2-481a-bc8b-ed8784076b75-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Volume volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de (17c93e9c-69f9-4f38-b9ec-f304b7ce09de): created successfully
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e01a4f-ad43-44b3-bb17-e187b66e5a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Flow 'volume_create_manager' (a32f69c2-fd33-4ec7-951f-36374ca4cb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bd7e3523-eaa4-4223-bacc-14651e1434c6 tempest-ProjectReaderTests-1068035897 None] Created volume successfully.
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "cinder-quobyte-4514e91a-8cc2-481a-bc8b-ed8784076b75" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-4514e91a-8cc2-481a-bc8b-ed8784076b75" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d4a742-8b2a-4d4e-96b0-e46d1cd4604d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:14 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75
Sep 23 00:35:14 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 of volume c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b4f8ff-3743-449a-b8e9-556e15a8e22a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:14 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09
Sep 23 00:35:14 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:14 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75" returned: 0 in 0.523s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:14 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75
Sep 23 00:35:14 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (d497da2e-d39e-4622-9007-00e977436387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23846154-eaca-4a0f-8fa1-9cec9880e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23846154-eaca-4a0f-8fa1-9cec9880e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645207976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8b109a-7310-4210-9568-fe66ef7a70f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:15Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9652d5-cd2b-45d2-923f-b1366c9f5f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9652d5-cd2b-45d2-923f-b1366c9f5f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9812671-6904-46b1-82c7-96227d15b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9812671-6904-46b1-82c7-96227d15b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8b109a-7310-4210-9568-fe66ef7a70f7', 'volume_name': 'volume-ff8b109a-7310-4210-9568-fe66ef7a70f7', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93297ece-5221-4007-8218-572f5ac80d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93297ece-5221-4007-8218-572f5ac80d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ad6163-e906-472e-b8d1-c52c9a8e11b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:15 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Volume ff8b109a-7310-4210-9568-fe66ef7a70f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8b109a-7310-4210-9568-fe66ef7a70f7', 'volume_size': 1}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "cinder-17c93e9c-69f9-4f38-b9ec-f304b7ce09de-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Lock "cinder-17c93e9c-69f9-4f38-b9ec-f304b7ce09de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "cinder-quobyte-17c93e9c-69f9-4f38-b9ec-f304b7ce09de" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:15 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4514e91a-8cc2-481a-bc8b-ed8784076b75" returned: 0 in 0.306s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-quobyte-4514e91a-8cc2-481a-bc8b-ed8784076b75" released by "delete_volume" :: held 0.890s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Lock "cinder-quobyte-17c93e9c-69f9-4f38-b9ec-f304b7ce09de" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:15 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09" returned: 0 in 0.629s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee53b9c-584d-4916-b65d-83225e9cc755]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 1G
Sep 23 00:35:15 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Created reservations ['2d5b9f82-f9bd-4150-9a4b-9048c90cff9b', '7c2c0276-3ec1-4f79-8dc3-88b34000ef83', '6972ac2b-dd80-479f-bc0c-310671600eb3', 'ad73f044-3b31-48c7-a6c1-97d22882421b', 'df57b611-75e2-4efe-801f-cb1eaf4c357e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:15 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de
Sep 23 00:35:15 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:15 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:15 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Deleted volume successfully.
Sep 23 00:35:15 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 1G" returned: 0 in 0.488s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67f0236-062b-4952-bc18-0197b848ff09 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-df442de5-6c90-4201-8eb0-ae51eb369332 tempest-CreateVolumesFromSourceVolumeTest-1221415277 None] Lock "cinder-4514e91a-8cc2-481a-bc8b-ed8784076b75-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de" returned: 0 in 0.493s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67f0236-062b-4952-bc18-0197b848ff09 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659
Sep 23 00:35:15 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de
Sep 23 00:35:15 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-17c93e9c-69f9-4f38-b9ec-f304b7ce09de" returned: 0 in 0.311s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Lock "cinder-quobyte-17c93e9c-69f9-4f38-b9ec-f304b7ce09de" released by "delete_volume" :: held 0.857s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:16 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67f0236-062b-4952-bc18-0197b848ff09 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" returned: 0 in 0.360s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 is being set with open permissions: ugo+rw
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:16 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659
Sep 23 00:35:16 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Created reservations ['b7407c50-79fa-4902-9d4d-caf35e32e07f', '2008ff42-aeaf-4ca5-8623-a06573951c07', '4902cc70-4e91-4533-82ea-ac6dcbfc15e8', '2f4f4db1-9a34-484d-a38d-75b1b7a42022', '4086dddb-1519-449d-b660-d12a1c2d0018'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:16 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:16 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" returned: 0 in 0.285s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:16 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info
Sep 23 00:35:16 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.309s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:16 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Deleted volume successfully.
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8e41c644-99f3-4168-ab9c-50dbe0e2a694 tempest-ProjectReaderTests-1068035897 None] Lock "cinder-17c93e9c-69f9-4f38-b9ec-f304b7ce09de-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:16 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info" returned: 0 in 0.334s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info is being set with open permissions: ugo+rw
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:16 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info
Sep 23 00:35:16 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Flow 'volume_create_manager' (8858e057-e6eb-4a18-8e2d-f9247649bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c05ce8-7fed-4e76-9644-68925ece6338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c05ce8-7fed-4e76-9644-68925ece6338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56597037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c123ed30-f12e-4511-9600-00ab008483e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9971dd069202481db8bd46b60d44f104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:17Z,use_quota=True,user_id='bc3acacde7fc4c64a44202578411c550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391241d9-98c5-493c-956a-7f54893cc596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391241d9-98c5-493c-956a-7f54893cc596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1607bb94-6622-4866-8a93-81724e406c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1607bb94-6622-4866-8a93-81724e406c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c123ed30-f12e-4511-9600-00ab008483e1', 'volume_name': 'volume-c123ed30-f12e-4511-9600-00ab008483e1', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7858d0-982f-46ff-ac72-f41c071500ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7858d0-982f-46ff-ac72-f41c071500ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:17 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175cd7b5-ac98-4253-bc86-c3dadbddd8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:17 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Volume c123ed30-f12e-4511-9600-00ab008483e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c123ed30-f12e-4511-9600-00ab008483e1', 'volume_size': 1}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.info" returned: 0 in 0.334s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645207976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8b109a-7310-4210-9568-fe66ef7a70f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:15Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Creating volume ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:17 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 1073741824
Sep 23 00:35:17 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-03cba313-0626-4f06-b426-57b8ed125e47 tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:35:17 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 1073741824" returned: 0 in 0.536s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-e0ddaa3e-522a-4d0d-b81d-6ea0032cc659-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-e0ddaa3e-522a-4d0d-b81d-6ea0032cc659-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-c67f0236-062b-4952-bc18-0197b848ff09" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:17 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7
Sep 23 00:35:17 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-c67f0236-062b-4952-bc18-0197b848ff09" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 of volume c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8910a1a5-49e1-4d41-872f-5c7fd18b6fd0]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659
Sep 23 00:35:17 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7" returned: 0 in 0.331s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56597037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c123ed30-f12e-4511-9600-00ab008483e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9971dd069202481db8bd46b60d44f104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:17Z,use_quota=True,user_id='bc3acacde7fc4c64a44202578411c550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Creating volume c123ed30-f12e-4511-9600-00ab008483e1 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:18 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ad6163-e906-472e-b8d1-c52c9a8e11b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8b109a-7310-4210-9568-fe66ef7a70f7', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:18 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1 1073741824
Sep 23 00:35:18 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ec3e83-24b0-4387-a22e-7a21106356d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:18 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Volume volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 (ff8b109a-7310-4210-9568-fe66ef7a70f7): created successfully
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ec3e83-24b0-4387-a22e-7a21106356d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (d497da2e-d39e-4622-9007-00e977436387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-11721d17-4353-4d25-b4cd-02c476357c53 tempest-ProjectReaderTests-173410677 None] Created volume successfully.
Sep 23 00:35:18 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" returned: 0 in 0.487s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67f0236-062b-4952-bc18-0197b848ff09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba0d70-d706-44c4-8680-bd938b490105]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09
Sep 23 00:35:18 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1 1073741824" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1
Sep 23 00:35:18 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09" returned: 0 in 0.432s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659
Sep 23 00:35:18 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1" returned: 0 in 0.290s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175cd7b5-ac98-4253-bc86-c3dadbddd8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c123ed30-f12e-4511-9600-00ab008483e1', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75535005-a101-40af-8d14-5f4b079da17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:18 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Volume volume-c123ed30-f12e-4511-9600-00ab008483e1 (c123ed30-f12e-4511-9600-00ab008483e1): created successfully
Sep 23 00:35:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75535005-a101-40af-8d14-5f4b079da17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Flow 'volume_create_manager' (8858e057-e6eb-4a18-8e2d-f9247649bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b80052e2-1644-4cc6-9d53-c83af13c1927 tempest-ProjectReaderTests-1068035897 None] Created volume successfully.
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Acquiring lock "cinder-c123ed30-f12e-4511-9600-00ab008483e1-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Lock "cinder-c123ed30-f12e-4511-9600-00ab008483e1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Acquiring lock "cinder-quobyte-c123ed30-f12e-4511-9600-00ab008483e1" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:19 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" returned: 0 in 0.492s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Lock "cinder-quobyte-c123ed30-f12e-4511-9600-00ab008483e1" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:19 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659
Sep 23 00:35:19 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c884db5f-d4ae-448d-bef2-cd4701e4c108]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack sudo[106605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1
Sep 23 00:35:19 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Creating offline snapshot 79d36931-cbca-4eb2-a137-130700633adf of volume ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3915fbe-d002-453c-ae3f-f4642eb782de]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09.e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" returned: 0 in 0.318s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-e0ddaa3e-522a-4d0d-b81d-6ea0032cc659" released by "_delete_snapshot" :: held 1.875s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-c67f0236-062b-4952-bc18-0197b848ff09" released by "delete_snapshot" :: held 1.903s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:19 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7
Sep 23 00:35:19 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Created reservations ['f944e7a4-85f9-4d37-bd0e-3139d313694d', 'c90d4077-bd72-42f5-a1fc-1577ad0f90f7', '7364f725-3bf6-49b5-9822-942c583ac5e4', 'dcba88fc-f78a-40c9-b562-07092dd19d66', '11ba3d84-eae8-4f40-a0f3-cee5f21ce20b'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:35:19 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1" returned: 0 in 0.539s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ecf407f3-babb-4be9-ac0d-3350a133f88e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-e0ddaa3e-522a-4d0d-b81d-6ea0032cc659-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-c67f0236-062b-4952-bc18-0197b848ff09-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:19 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1
Sep 23 00:35:19 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-c67f0236-062b-4952-bc18-0197b848ff09-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-c67f0236-062b-4952-bc18-0197b848ff09" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-c67f0236-062b-4952-bc18-0197b848ff09" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:20 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7" returned: 0 in 0.510s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf 1G
Sep 23 00:35:20 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fb6a8c-195f-4d34-82ff-ea52427213a8]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09
Sep 23 00:35:20 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c123ed30-f12e-4511-9600-00ab008483e1" returned: 0 in 0.347s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Lock "cinder-quobyte-c123ed30-f12e-4511-9600-00ab008483e1" released by "delete_volume" :: held 0.953s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Created reservations ['bb6c5366-5828-42aa-8aab-165aaf170266', 'ef412f11-73f2-4a76-a8b7-9b12ae4586ed', '2bc1939b-ecce-4c8c-9edd-547760b3b77f', '34e66fd5-55df-497a-9b9a-3ca025f63cb5', '868cb7dc-65c5-402d-ab01-d843ad3fd9a5'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:20 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09" returned: 0 in 0.445s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09
Sep 23 00:35:20 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf 1G" returned: 0 in 0.611s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf
Sep 23 00:35:20 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.311s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:20 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Deleted volume successfully.
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-1f94a63a-4b46-46e6-ab7d-7404a7fefcdf tempest-ProjectReaderTests-1068035897 None] Lock "cinder-c123ed30-f12e-4511-9600-00ab008483e1-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:20 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-c67f0236-062b-4952-bc18-0197b848ff09" returned: 0 in 0.340s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-c67f0236-062b-4952-bc18-0197b848ff09" released by "delete_volume" :: held 0.888s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:20 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Created reservations ['246804cb-23c0-43d1-8500-234de33ce6b5', 'a45fdb30-0a9b-41a5-9c9e-5d32078885eb', 'f4ffd274-f105-420f-a3f1-f52dbdcdfcd8', '01d0ab03-b90d-4de8-8b23-d72c4c66817c', '077f3f5b-9064-47a5-8e9e-9d2c01d9be98'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:21 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf" returned: 0 in 0.363s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf is being set with open permissions: ugo+rw
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:21 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf
Sep 23 00:35:21 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:21 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf" returned: 0 in 0.323s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.321s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:35:21 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info
Sep 23 00:35:21 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8ea20757-b223-4082-b07d-e7b130cec0f6 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-c67f0236-062b-4952-bc18-0197b848ff09-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:21 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info" returned: 0 in 0.314s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info is being set with open permissions: ugo+rw
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info
Sep 23 00:35:21 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (a74ba344-d75c-40a3-bef0-7968d6d53d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d20b4c7-d658-47b8-b9a7-cafe85a75a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d20b4c7-d658-47b8-b9a7-cafe85a75a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520157830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c8d6ad-c7b0-4fc7-860c-64669d555947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:22Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2c91d2-04a1-4c00-8d87-44b209134060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2c91d2-04a1-4c00-8d87-44b209134060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e35b88-6abc-4c0b-bbcc-da12b85a28d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e35b88-6abc-4c0b-bbcc-da12b85a28d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c8d6ad-c7b0-4fc7-860c-64669d555947', 'volume_name': 'volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206be5e6-75f5-4f6e-8b92-ea826c88e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206be5e6-75f5-4f6e-8b92-ea826c88e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0669ec2-11ff-44fb-b0a9-90cfc08e68ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:21 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Volume f4c8d6ad-c7b0-4fc7-860c-64669d555947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947', 'volume_size': 1}
Sep 23 00:35:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:22 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.info" returned: 0 in 0.308s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.160s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520157830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c8d6ad-c7b0-4fc7-860c-64669d555947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:22Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Creating volume f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:22 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 1073741824
Sep 23 00:35:22 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-834e9e38-54b1-4cb7-abbd-1635d86555d6 tempest-ProjectReaderTests-173410677 None] Create snapshot completed successfully
Sep 23 00:35:22 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 1073741824" returned: 0 in 0.568s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947
Sep 23 00:35:22 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-79d36931-cbca-4eb2-a137-130700633adf-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Lock "cinder-79d36931-cbca-4eb2-a137-130700633adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-ff8b109a-7310-4210-9568-fe66ef7a70f7" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-ff8b109a-7310-4210-9568-fe66ef7a70f7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-79d36931-cbca-4eb2-a137-130700633adf" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-79d36931-cbca-4eb2-a137-130700633adf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Deleting offline snapshot 79d36931-cbca-4eb2-a137-130700633adf of volume ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] snapshot_file for this snap is: volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c7cf69-8a91-477f-a29a-24909fc4cb12]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf
Sep 23 00:35:23 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947" returned: 0 in 0.365s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0669ec2-11ff-44fb-b0a9-90cfc08e68ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee846146-891f-4d78-8479-84a9acfd3478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:23 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Volume volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 (f4c8d6ad-c7b0-4fc7-860c-64669d555947): created successfully
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee846146-891f-4d78-8479-84a9acfd3478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (a74ba344-d75c-40a3-bef0-7968d6d53d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:23 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d4ec0bb4-90b3-4324-90d2-a7999e1b96ab tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:35:23 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf" returned: 0 in 0.473s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff8b109a-7310-4210-9568-fe66ef7a70f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc9d98-e521-43a3-80f9-7dbc7313fc64]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7
Sep 23 00:35:23 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7" returned: 0 in 0.506s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf
Sep 23 00:35:23 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot d6a4819e-917d-4e22-aa25-8281f98bf5a9 of volume f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff6b03f-365c-4942-ba89-3c2d7dab142d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:24 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf" returned: 0 in 0.451s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:24 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947
Sep 23 00:35:24 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:24 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf
Sep 23 00:35:24 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:24 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7.79d36931-cbca-4eb2-a137-130700633adf" returned: 0 in 0.314s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:24 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947" returned: 0 in 0.471s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-79d36931-cbca-4eb2-a137-130700633adf" released by "_delete_snapshot" :: held 1.896s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-ff8b109a-7310-4210-9568-fe66ef7a70f7" released by "delete_snapshot" :: held 1.928s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:24 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 1G
Sep 23 00:35:24 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Created reservations ['183a8d42-544e-4c49-8aec-a11789bdea8f', '4faf37a5-c4c3-4a19-b407-1f971024dce6', '79b9b64d-f2ee-42a2-8224-c155f872b0dc', '3e9cca83-0475-4074-a62b-1919273cc329', '301a0c1c-57a4-49ad-9cee-70c0ae094c79'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:24 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Delete snapshot completed successfully.
Sep 23 00:35:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ce7b24dd-4ad4-4994-87ea-bc9f5e2afcd7 tempest-ProjectReaderTests-173410677 None] Lock "cinder-79d36931-cbca-4eb2-a137-130700633adf-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-ff8b109a-7310-4210-9568-fe66ef7a70f7-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Lock "cinder-ff8b109a-7310-4210-9568-fe66ef7a70f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-ff8b109a-7310-4210-9568-fe66ef7a70f7" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-ff8b109a-7310-4210-9568-fe66ef7a70f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c61c4b-a86a-41e7-b314-d48e41339446]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7
Sep 23 00:35:25 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 1G" returned: 0 in 0.532s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9
Sep 23 00:35:25 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7
Sep 23 00:35:25 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9" returned: 0 in 0.334s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:25 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 is being set with open permissions: ugo+rw
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9
Sep 23 00:35:25 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ff8b109a-7310-4210-9568-fe66ef7a70f7" returned: 0 in 0.287s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-ff8b109a-7310-4210-9568-fe66ef7a70f7" released by "delete_volume" :: held 0.774s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:25 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9" returned: 0 in 0.282s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Created reservations ['9d14da21-d9eb-45af-817e-fa344d595a79', '956f1bae-698f-44a1-b9ef-27d7c3e1e7c6', '390b3814-54a0-44e7-914c-ee59eb064568', 'a65720b5-0e05-4185-8a57-39a0b8918b6a', 'a80eb54a-ed1b-4a88-a3db-b28fd70a6e91'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:25 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info
Sep 23 00:35:25 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:26 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:26 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:26 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info" returned: 0 in 0.308s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info is being set with open permissions: ugo+rw
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:26 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info
Sep 23 00:35:26 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:26 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.330s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Deleted volume successfully.
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-6f5de4af-79b1-44d3-a35d-7edd70c41d08 tempest-ProjectReaderTests-173410677 None] Lock "cinder-ff8b109a-7310-4210-9568-fe66ef7a70f7-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:26 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.info" returned: 0 in 0.315s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:26 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-833930b0-487e-4428-bf12-e333c45b55f2 tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (f28fa9b2-0f10-41f1-ac91-558221322ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18460bea-b361-43d4-95b7-e0cb24aac0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18460bea-b361-43d4-95b7-e0cb24aac0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1456012577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62145803-e21c-4a14-8257-d4ff075c2a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:27Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4672dfd7-1779-4dde-b2f2-3f907c26498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4672dfd7-1779-4dde-b2f2-3f907c26498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf48dac-9db8-41ef-84ee-2d58e4712813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf48dac-9db8-41ef-84ee-2d58e4712813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62145803-e21c-4a14-8257-d4ff075c2a7b', 'volume_name': 'volume-62145803-e21c-4a14-8257-d4ff075c2a7b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1744ea-90a1-46c3-b4f7-ac0685d77f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1744ea-90a1-46c3-b4f7-ac0685d77f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c3c01-fd62-4dd8-bd02-c1ea55e36ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:26 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Volume 62145803-e21c-4a14-8257-d4ff075c2a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62145803-e21c-4a14-8257-d4ff075c2a7b', 'volume_size': 1}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1456012577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62145803-e21c-4a14-8257-d4ff075c2a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:27Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Creating volume 62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:26 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:27 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b 1073741824
Sep 23 00:35:27 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-d6a4819e-917d-4e22-aa25-8281f98bf5a9-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-d6a4819e-917d-4e22-aa25-8281f98bf5a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-f4c8d6ad-c7b0-4fc7-860c-64669d555947" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-f4c8d6ad-c7b0-4fc7-860c-64669d555947" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-d6a4819e-917d-4e22-aa25-8281f98bf5a9" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-d6a4819e-917d-4e22-aa25-8281f98bf5a9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot d6a4819e-917d-4e22-aa25-8281f98bf5a9 of volume f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:27 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b 1073741824" returned: 0 in 0.545s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4bb853-c878-483c-8366-97782dddc1f5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:27 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b
Sep 23 00:35:27 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:27 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9
Sep 23 00:35:27 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:27 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b" returned: 0 in 0.298s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c3c01-fd62-4dd8-bd02-c1ea55e36ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62145803-e21c-4a14-8257-d4ff075c2a7b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421ba129-999e-49d5-9f7a-1a36d3bcd99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:27 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Volume volume-62145803-e21c-4a14-8257-d4ff075c2a7b (62145803-e21c-4a14-8257-d4ff075c2a7b): created successfully
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421ba129-999e-49d5-9f7a-1a36d3bcd99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:27 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (f28fa9b2-0f10-41f1-ac91-558221322ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-7e71e82d-fc5c-4de6-9d85-4427e1832f41 tempest-ProjectReaderTests-173410677 None] Created volume successfully.
Sep 23 00:35:27 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9" returned: 0 in 0.445s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa747a-ac0b-4bfe-a478-b5253f72fab6]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:28 devstack sudo[106733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947
Sep 23 00:35:28 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:28 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:28 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9
Sep 23 00:35:28 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:28 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9" returned: 0 in 0.366s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:28 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9
Sep 23 00:35:28 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:29 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947.d6a4819e-917d-4e22-aa25-8281f98bf5a9" returned: 0 in 0.366s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-d6a4819e-917d-4e22-aa25-8281f98bf5a9" released by "_delete_snapshot" :: held 1.730s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-f4c8d6ad-c7b0-4fc7-860c-64669d555947" released by "delete_snapshot" :: held 1.779s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Creating offline snapshot c640e64f-db68-49ad-b7d3-b13bbc7f2881 of volume 62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89a5aaf-95a9-46a8-80ab-0e92df3d4857]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Created reservations ['7cbad3eb-ddc5-4eaa-a4c7-2ce117f19124', 'a50418e8-3bec-4593-af60-e0658062f14b', '23f7e086-db0c-4608-904a-df51628869f9', 'e89e3beb-bc6c-4150-afa3-2211ee047804', 'ba697021-61d9-4bc3-b5da-4b0162e51b7a'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:29 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b
Sep 23 00:35:29 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:29 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba4d5363-a064-4691-bf5d-43ad219a5da4 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-d6a4819e-917d-4e22-aa25-8281f98bf5a9-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-f4c8d6ad-c7b0-4fc7-860c-64669d555947-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-f4c8d6ad-c7b0-4fc7-860c-64669d555947-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-f4c8d6ad-c7b0-4fc7-860c-64669d555947" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-f4c8d6ad-c7b0-4fc7-860c-64669d555947" acquired by "delete_volume" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:29 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4061cd-63e1-4ce5-892e-2d1cc7664118]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 1G
Sep 23 00:35:29 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:30 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947
Sep 23 00:35:30 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:30 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:30 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947
Sep 23 00:35:30 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:30 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 1G" returned: 0 in 0.526s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62145803-e21c-4a14-8257-d4ff075c2a7b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:30 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62145803-e21c-4a14-8257-d4ff075c2a7b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881
Sep 23 00:35:30 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:30 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-f4c8d6ad-c7b0-4fc7-860c-64669d555947" returned: 0 in 0.266s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-f4c8d6ad-c7b0-4fc7-860c-64669d555947" released by "delete_volume" :: held 0.817s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Created reservations ['91f3151d-0946-4b6b-ba2a-ad7eade58cac', '598f589a-27d0-4aa3-b64c-637fe1590a95', 'c6dd6025-be74-4069-85d5-9b4ce2871f03', '6e1663a8-25bf-41a6-a9e3-1c57714e53b0', '1ccdb0d3-7171-4169-af06-73de83a525fe'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:30 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62145803-e21c-4a14-8257-d4ff075c2a7b -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:30 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 is being set with open permissions: ugo+rw
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:30 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881
Sep 23 00:35:30 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:30 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:30 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:31 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881" returned: 0 in 0.370s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:31 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.310s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-3dfd41aa-ba1e-43cd-8a38-811f0652810d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-f4c8d6ad-c7b0-4fc7-860c-64669d555947-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:31 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info
Sep 23 00:35:31 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:31 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info" returned: 0 in 0.347s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:31 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info is being set with open permissions: ugo+rw
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:31 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info
Sep 23 00:35:31 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (1a11fc2a-e406-4bd5-b85e-d52d925d268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999c4d03-0606-4fea-bbb8-c8d016863a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999c4d03-0606-4fea-bbb8-c8d016863a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064239868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e3f8c4-ecca-49f5-8ac4-2daf79397891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:32Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2402b29a-7410-4831-9f5c-6e5f261d3e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2402b29a-7410-4831-9f5c-6e5f261d3e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f26891-9486-4c50-813b-de81057e7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f26891-9486-4c50-813b-de81057e7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e3f8c4-ecca-49f5-8ac4-2daf79397891', 'volume_name': 'volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c634bc-8937-43eb-aaf4-6439853fb709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c634bc-8937-43eb-aaf4-6439853fb709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b7592b-6814-4864-b4b1-569b34420be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Volume a0e3f8c4-ecca-49f5-8ac4-2daf79397891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891', 'volume_size': 1}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:31 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.info" returned: 0 in 0.287s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064239868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e3f8c4-ecca-49f5-8ac4-2daf79397891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:32Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Creating volume a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:31 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:31 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 1073741824
Sep 23 00:35:31 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:31 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-edd3ead4-98b3-434f-9ae3-a2f415096a89 tempest-ProjectReaderTests-173410677 None] Create snapshot completed successfully
Sep 23 00:35:32 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 1073741824" returned: 0 in 0.465s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:32 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891
Sep 23 00:35:32 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-c640e64f-db68-49ad-b7d3-b13bbc7f2881-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Lock "cinder-c640e64f-db68-49ad-b7d3-b13bbc7f2881-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-62145803-e21c-4a14-8257-d4ff075c2a7b" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-62145803-e21c-4a14-8257-d4ff075c2a7b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-c640e64f-db68-49ad-b7d3-b13bbc7f2881" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-c640e64f-db68-49ad-b7d3-b13bbc7f2881" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Deleting offline snapshot c640e64f-db68-49ad-b7d3-b13bbc7f2881 of volume 62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] snapshot_file for this snap is: volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (ce6df4b2-5bdd-4843-a519-4e20a9901197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20aeac0-d4a7-43e4-b18e-521d9540d8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c97ddb-97c5-4c08-8ee2-7420e8c3e713]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20aeac0-d4a7-43e4-b18e-521d9540d8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-706219276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f99cb40-e621-4976-910e-179dc66a8114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:33Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c100308-2ebd-44da-960e-87ab64cb0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c100308-2ebd-44da-960e-87ab64cb0f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64434c82-966f-4311-90f7-05bfb819ce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64434c82-966f-4311-90f7-05bfb819ce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f99cb40-e621-4976-910e-179dc66a8114', 'volume_name': 'volume-1f99cb40-e621-4976-910e-179dc66a8114', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1a3c76-f409-48ac-937d-f1f0f80e1dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1a3c76-f409-48ac-937d-f1f0f80e1dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e07929-b057-4edf-a355-8b5d10cdc41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Volume 1f99cb40-e621-4976-910e-179dc66a8114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f99cb40-e621-4976-910e-179dc66a8114', 'volume_size': 1}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" returned: 0 in 0.454s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-706219276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f99cb40-e621-4976-910e-179dc66a8114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:33Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Creating volume 1f99cb40-e621-4976-910e-179dc66a8114 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:32 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b7592b-6814-4864-b4b1-569b34420be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114 1073741824
Sep 23 00:35:32 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157783ef-5d4e-4147-9e10-5eb432257f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881
Sep 23 00:35:32 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Volume volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 (a0e3f8c4-ecca-49f5-8ac4-2daf79397891): created successfully
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157783ef-5d4e-4147-9e10-5eb432257f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (1a11fc2a-e406-4bd5-b85e-d52d925d268c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:32 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ad81f9d1-8c5a-4785-b027-73f1a0796537 tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:35:33 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881" returned: 0 in 0.393s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62145803-e21c-4a14-8257-d4ff075c2a7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af340b1a-7fee-4b39-adff-d3de868fe194]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:33 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b
Sep 23 00:35:33 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:33 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114 1073741824" returned: 0 in 0.465s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:33 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114
Sep 23 00:35:33 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:33 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b" returned: 0 in 0.430s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:33 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114" returned: 0 in 0.271s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:33 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881
Sep 23 00:35:33 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e07929-b057-4edf-a355-8b5d10cdc41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f99cb40-e621-4976-910e-179dc66a8114', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4993ecdb-73cf-4fd6-8b8d-bb595ad1c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Volume volume-1f99cb40-e621-4976-910e-179dc66a8114 (1f99cb40-e621-4976-910e-179dc66a8114): created successfully
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4993ecdb-73cf-4fd6-8b8d-bb595ad1c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (ce6df4b2-5bdd-4843-a519-4e20a9901197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-e12f7e96-d9b3-4d43-a7e2-f8450b338845 tempest-ProjectReaderTests-1703755618 None] Created volume successfully.
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot 68917680-3436-4ffe-94f4-3182cc3e049a of volume a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:34 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881" returned: 0 in 0.397s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffcdc5e-5d48-4e14-b124-5a6fb3dd6991]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881
Sep 23 00:35:34 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:34 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891
Sep 23 00:35:34 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:34 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b.c640e64f-db68-49ad-b7d3-b13bbc7f2881" returned: 0 in 0.286s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-c640e64f-db68-49ad-b7d3-b13bbc7f2881" released by "_delete_snapshot" :: held 1.651s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-62145803-e21c-4a14-8257-d4ff075c2a7b" released by "delete_snapshot" :: held 1.731s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Created reservations ['df0b19fb-c4fa-409d-b29e-010174b23250', '261c0daa-3d06-49ab-b11f-3616f400e404', 'f7000e26-cf6e-4974-8a45-7403c70a529e', '1b2cbed6-b6f2-4ef5-98f6-a559ced8efa6', '15ef4ebf-f0b0-4192-88ec-1e2343cc898e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:34 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" returned: 0 in 0.400s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a 1G
Sep 23 00:35:34 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:34 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Delete snapshot completed successfully.
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-64fa8481-a6de-4392-a442-5672e6eb9c8a tempest-ProjectReaderTests-173410677 None] Lock "cinder-c640e64f-db68-49ad-b7d3-b13bbc7f2881-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-62145803-e21c-4a14-8257-d4ff075c2a7b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Lock "cinder-62145803-e21c-4a14-8257-d4ff075c2a7b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-62145803-e21c-4a14-8257-d4ff075c2a7b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-62145803-e21c-4a14-8257-d4ff075c2a7b" acquired by "delete_volume" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:34 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f7ea6-bac2-4152-81d8-7ff4a5ad30a2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a 1G" returned: 0 in 0.553s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-1f99cb40-e621-4976-910e-179dc66a8114-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:35 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a
Sep 23 00:35:35 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Lock "cinder-1f99cb40-e621-4976-910e-179dc66a8114-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-quobyte-1f99cb40-e621-4976-910e-179dc66a8114" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-1f99cb40-e621-4976-910e-179dc66a8114" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:35 devstack sudo[106867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b
Sep 23 00:35:35 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[47501cd5-d0c5-42dc-ac8e-a5c6412ceaad]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114
Sep 23 00:35:35 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a" returned: 0 in 0.363s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a is being set with open permissions: ugo+rw
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a
Sep 23 00:35:35 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b" returned: 0 in 0.486s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b
Sep 23 00:35:35 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114" returned: 0 in 0.404s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114
Sep 23 00:35:35 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a" returned: 0 in 0.268s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info
Sep 23 00:35:35 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-62145803-e21c-4a14-8257-d4ff075c2a7b" returned: 0 in 0.270s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-62145803-e21c-4a14-8257-d4ff075c2a7b" released by "delete_volume" :: held 0.855s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Created reservations ['63bd6a34-574d-4672-9c34-96f60f53969b', '8019ec92-af8d-4a2f-8ceb-f819442a305f', 'a7b908a2-3292-46dd-a6a0-80782623f686', '03192977-8437-42e5-9697-e22048caaca7', '662df134-67c4-4e84-b81e-e90f6616b8c3'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:35 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-1f99cb40-e621-4976-910e-179dc66a8114" returned: 0 in 0.296s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-1f99cb40-e621-4976-910e-179dc66a8114" released by "delete_volume" :: held 0.745s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:35 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info" returned: 0 in 0.304s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info is being set with open permissions: ugo+rw
Sep 23 00:35:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info
Sep 23 00:35:35 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Created reservations ['1ee33037-baf5-47af-a589-16d3c2ed68ba', 'a0c02141-af53-4856-b4c0-b8f2c80c3881', '3551994c-8b7f-428e-a4d1-eec0ed4060f7', '6a425ea3-69c3-475f-a396-91ca5fadfabb', '024b5f74-33c4-46c7-94a9-c9a3b869ef7e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:36 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:36 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:36 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.356s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Deleted volume successfully.
Sep 23 00:35:36 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.info" returned: 0 in 0.352s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-45acc3d0-61d4-4a3a-9e73-81ba020bafda tempest-ProjectReaderTests-173410677 None] Lock "cinder-62145803-e21c-4a14-8257-d4ff075c2a7b-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-045303d5-37e8-4a60-a005-941f1a34fee3 tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:35:36 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.350s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Deleted volume successfully.
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-20dd2b75-5970-468c-bd7a-cabe5bea6adf tempest-ProjectReaderTests-1703755618 None] Lock "cinder-1f99cb40-e621-4976-910e-179dc66a8114-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (7249db07-6c0b-4cf1-b243-25433d1f5522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db19893-a87b-4c7e-b846-cbe7e33a575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db19893-a87b-4c7e-b846-cbe7e33a575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032161186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc4c9ae-ce9f-4380-9c7a-2058d2374985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:37Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9485eda9-5e13-4a82-be03-d7b98cf3f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9485eda9-5e13-4a82-be03-d7b98cf3f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d3401e-0426-4bca-8b9b-3a9cbc82c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d3401e-0426-4bca-8b9b-3a9cbc82c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc4c9ae-ce9f-4380-9c7a-2058d2374985', 'volume_name': 'volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59df7768-8c3f-4ac1-b675-3274d81132de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59df7768-8c3f-4ac1-b675-3274d81132de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063ce264-aefc-49f9-9f5b-d661e541a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:36 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Volume dfc4c9ae-ce9f-4380-9c7a-2058d2374985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985', 'volume_size': 1}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032161186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc4c9ae-ce9f-4380-9c7a-2058d2374985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:37Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Creating volume dfc4c9ae-ce9f-4380-9c7a-2058d2374985 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:36 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:36 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 1073741824
Sep 23 00:35:36 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-68917680-3436-4ffe-94f4-3182cc3e049a-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-68917680-3436-4ffe-94f4-3182cc3e049a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-68917680-3436-4ffe-94f4-3182cc3e049a" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-68917680-3436-4ffe-94f4-3182cc3e049a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot 68917680-3436-4ffe-94f4-3182cc3e049a of volume a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d09f20-41fc-4f8c-8753-d900a39480fc]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:37 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 1073741824" returned: 0 in 0.472s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:37 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a
Sep 23 00:35:37 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:37 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985
Sep 23 00:35:37 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:37 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985" returned: 0 in 0.281s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:37 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a" returned: 0 in 0.392s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063ce264-aefc-49f9-9f5b-d661e541a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a7a813-1b93-40b3-a15c-6a38af65ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c82daa-df94-4d79-8073-02a186123627]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Volume volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 (dfc4c9ae-ce9f-4380-9c7a-2058d2374985): created successfully
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a7a813-1b93-40b3-a15c-6a38af65ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (7249db07-6c0b-4cf1-b243-25433d1f5522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (f7ddd50c-98c7-409c-bf06-ee0f60b7fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87040fe0-42ed-44ba-b0ef-fcdf3bcee355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-70810b53-dc5c-4b8a-9a3f-f6e60d0cf1cd tempest-ProjectReaderTests-1703755618 None] Created volume successfully.
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87040fe0-42ed-44ba-b0ef-fcdf3bcee355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914033768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7d9d96-f394-4619-99b3-d6f242e36d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:38Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e746b8-1d84-4f58-ae53-270fdc1e6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e746b8-1d84-4f58-ae53-270fdc1e6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae12876-35b0-41fe-b44d-88ef996493e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891
Sep 23 00:35:37 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae12876-35b0-41fe-b44d-88ef996493e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7d9d96-f394-4619-99b3-d6f242e36d6e', 'volume_name': 'volume-db7d9d96-f394-4619-99b3-d6f242e36d6e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffd2ee-defe-402a-bc48-c378d546916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffd2ee-defe-402a-bc48-c378d546916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c73017c-4724-43f2-ac15-e0026c0ba324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Volume db7d9d96-f394-4619-99b3-d6f242e36d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7d9d96-f394-4619-99b3-d6f242e36d6e', 'volume_size': 1}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914033768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7d9d96-f394-4619-99b3-d6f242e36d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967fc00368a3401199131c8caf68dc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:38Z,use_quota=True,user_id='fbf763ddcc0a40b09245f78b2306ef62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Creating volume db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:37 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:37 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e 1073741824
Sep 23 00:35:37 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:38 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" returned: 0 in 0.384s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:38 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a
Sep 23 00:35:38 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:38 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e 1073741824" returned: 0 in 0.456s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:38 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e
Sep 23 00:35:38 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:38 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a" returned: 0 in 0.375s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:38 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a
Sep 23 00:35:38 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:38 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e" returned: 0 in 0.288s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c73017c-4724-43f2-ac15-e0026c0ba324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7d9d96-f394-4619-99b3-d6f242e36d6e', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270b02d2-727f-4d66-bdc2-d6abe1a731b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:38 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Volume volume-db7d9d96-f394-4619-99b3-d6f242e36d6e (db7d9d96-f394-4619-99b3-d6f242e36d6e): created successfully
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270b02d2-727f-4d66-bdc2-d6abe1a731b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Flow 'volume_create_manager' (f7ddd50c-98c7-409c-bf06-ee0f60b7fafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2aea3e92-2759-4913-b8c9-726f4438c1ee tempest-ProjectReaderTests-173410677 None] Created volume successfully.
Sep 23 00:35:38 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891.68917680-3436-4ffe-94f4-3182cc3e049a" returned: 0 in 0.282s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-68917680-3436-4ffe-94f4-3182cc3e049a" released by "_delete_snapshot" :: held 1.583s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" released by "delete_snapshot" :: held 1.610s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Created reservations ['595a34e3-1a3f-4408-820d-25923aab93fa', '249ca1c9-4716-4645-803d-e70457a5987e', 'a7b5f050-9437-4b2e-894d-f7e1f3a9409a', 'b7c2ce80-0633-420a-ae01-6c62964f44a2', 'b2c918c9-ee17-492b-ab90-89294b17335e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-dfc4c9ae-ce9f-4380-9c7a-2058d2374985-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-dfc4c9ae-ce9f-4380-9c7a-2058d2374985-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-quobyte-dfc4c9ae-ce9f-4380-9c7a-2058d2374985" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-dfc4c9ae-ce9f-4380-9c7a-2058d2374985" acquired by "delete_volume" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a8b50002-47e4-4d4e-b08c-100e5e4e269d tempest-ProjectMemberTests-1230768810 None] Lock "cinder-68917680-3436-4ffe-94f4-3182cc3e049a-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cfc43f-44dc-42ad-8c98-edd5593c0abd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:39 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985
Sep 23 00:35:39 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-a0e3f8c4-ecca-49f5-8ac4-2daf79397891-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-a0e3f8c4-ecca-49f5-8ac4-2daf79397891-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" acquired by "delete_volume" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:39 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985" returned: 0 in 0.444s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f926b-f865-4234-aafa-80e97abd9d1f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:39 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985
Sep 23 00:35:39 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:39 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891
Sep 23 00:35:39 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:39 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-dfc4c9ae-ce9f-4380-9c7a-2058d2374985" returned: 0 in 0.257s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-dfc4c9ae-ce9f-4380-9c7a-2058d2374985" released by "delete_volume" :: held 0.752s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Created reservations ['d5fc2a82-2fa8-4573-b1bd-8c25f32e18af', 'e0a4dfce-56aa-488f-8fca-903c77526466', 'a70dd52e-9042-451d-a8ed-d0df5d3c26a0', '3a66ad1e-c85d-44d4-b1d5-0c15828ac13d', '1ea7416a-ec42-4946-a014-2792494f3dda'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" returned: 0 in 0.451s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:40 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:40 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891
Sep 23 00:35:40 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:40 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Creating offline snapshot 41a5e3d1-74ba-4fa5-a21b-95cebd7653cc of volume db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[644a6a00-58e9-4b2b-8253-5daea13742cf]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.375s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:35:40 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.336s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:40 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Deleted volume successfully.
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-dba5fe4c-8927-4e98-ae2d-bc3d21e24ae2 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-dfc4c9ae-ce9f-4380-9c7a-2058d2374985-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:40 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e
Sep 23 00:35:40 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" returned: 0 in 0.479s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a0e3f8c4-ecca-49f5-8ac4-2daf79397891" released by "delete_volume" :: held 1.011s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Created reservations ['d9760ed6-4c49-4ebd-a51e-ef9cd74c561c', '6e608820-68e4-4c62-b7e0-a0f0f466e5f6', '08b12793-a3f7-480e-b894-0703cfe3cd4e', '4b438fc0-254e-4a47-a09f-81b3c85c266b', '42d20d95-4b42-499c-8e6e-ed1f108da8a2'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:40 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e" returned: 0 in 0.499s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc 1G
Sep 23 00:35:40 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (af424390-46ac-4783-85dd-d2cd4041e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdb981b-1e1a-4dd8-84e8-fc0fc5400f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:41 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdb981b-1e1a-4dd8-84e8-fc0fc5400f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989662327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b77c26d-a668-4fc3-8777-1d5bcf12dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:41Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4067d9-ceb8-4d49-b217-2fcbd3b361ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4067d9-ceb8-4d49-b217-2fcbd3b361ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5c3a45-abc4-4224-af00-e334a938e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5c3a45-abc4-4224-af00-e334a938e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b77c26d-a668-4fc3-8777-1d5bcf12dce3', 'volume_name': 'volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2ccc7f-c35b-4ed6-8711-39384c62c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2ccc7f-c35b-4ed6-8711-39384c62c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94bd00a-cd98-448f-a4e6-bdeea1e64adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:41 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Volume 4b77c26d-a668-4fc3-8777-1d5bcf12dce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3', 'volume_size': 1}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.371s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:41 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-4aae8c35-90c6-4963-9b0e-2c892eb82a56 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-a0e3f8c4-ecca-49f5-8ac4-2daf79397891-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:41 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc 1G" returned: 0 in 0.464s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7d9d96-f394-4619-99b3-d6f242e36d6e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:41 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7d9d96-f394-4619-99b3-d6f242e36d6e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc
Sep 23 00:35:41 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:41 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7d9d96-f394-4619-99b3-d6f242e36d6e -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" returned: 0 in 0.287s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:41 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc is being set with open permissions: ugo+rw
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:41 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc
Sep 23 00:35:41 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:41 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" returned: 0 in 0.289s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:41 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:41 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info
Sep 23 00:35:41 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:42 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info" returned: 0 in 0.268s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info is being set with open permissions: ugo+rw
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:42 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info
Sep 23 00:35:42 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (6bf289f2-b70a-4160-bae6-6a7e6ba89a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cf4304-f937-46e0-8ff4-43b8f62ef283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cf4304-f937-46e0-8ff4-43b8f62ef283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822128227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff35a49-e80e-473f-ac05-78562531021f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:42Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e885b8b-ef85-4c20-a7a8-eaa9007b373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e885b8b-ef85-4c20-a7a8-eaa9007b373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f6abe1-6652-4f89-9cdd-3d55b572fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f6abe1-6652-4f89-9cdd-3d55b572fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff35a49-e80e-473f-ac05-78562531021f', 'volume_name': 'volume-7ff35a49-e80e-473f-ac05-78562531021f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2404845e-a254-4571-9abf-9a83e0a7e94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2404845e-a254-4571-9abf-9a83e0a7e94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cea82b1-1e8f-4a21-b1ab-2cc5c9e80453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:42 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Volume 7ff35a49-e80e-473f-ac05-78562531021f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff35a49-e80e-473f-ac05-78562531021f', 'volume_size': 1}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:42 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.info" returned: 0 in 0.240s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989662327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b77c26d-a668-4fc3-8777-1d5bcf12dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:41Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Creating volume 4b77c26d-a668-4fc3-8777-1d5bcf12dce3 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:42 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:42 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 1073741824
Sep 23 00:35:42 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:42 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4a61634e-bf07-4fd2-ad50-f6297879c43f tempest-ProjectReaderTests-173410677 None] Create snapshot completed successfully
Sep 23 00:35:42 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 1073741824" returned: 0 in 0.419s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:42 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3
Sep 23 00:35:42 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:43 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3" returned: 0 in 0.239s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822128227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff35a49-e80e-473f-ac05-78562531021f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:42Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Creating volume 7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:43 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94bd00a-cd98-448f-a4e6-bdeea1e64adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:43 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f 1073741824
Sep 23 00:35:43 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a994fea-d523-483f-b81d-ba80fadbf721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Volume volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 (4b77c26d-a668-4fc3-8777-1d5bcf12dce3): created successfully
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a994fea-d523-483f-b81d-ba80fadbf721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (af424390-46ac-4783-85dd-d2cd4041e036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:43 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1cdc0c6d-b6e6-4fab-a173-d7fe7390c083 tempest-ProjectReaderTests-1703755618 None] Created volume successfully.
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-41a5e3d1-74ba-4fa5-a21b-95cebd7653cc-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Lock "cinder-41a5e3d1-74ba-4fa5-a21b-95cebd7653cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-db7d9d96-f394-4619-99b3-d6f242e36d6e" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-db7d9d96-f394-4619-99b3-d6f242e36d6e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Deleting offline snapshot 41a5e3d1-74ba-4fa5-a21b-95cebd7653cc of volume db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] snapshot_file for this snap is: volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4ba5a-310d-4d5f-a980-17e65ad4813a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:43 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f 1073741824" returned: 0 in 0.474s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:43 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc
Sep 23 00:35:43 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:43 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f
Sep 23 00:35:43 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:43 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f" returned: 0 in 0.260s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:43 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7d9d96-f394-4619-99b3-d6f242e36d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cea82b1-1e8f-4a21-b1ab-2cc5c9e80453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff35a49-e80e-473f-ac05-78562531021f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75230791-af6b-440e-984c-760572428ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[75148c34-7a55-41f5-841e-763f56a0e6da]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:43 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Volume volume-7ff35a49-e80e-473f-ac05-78562531021f (7ff35a49-e80e-473f-ac05-78562531021f): created successfully
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75230791-af6b-440e-984c-760572428ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:43 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (6bf289f2-b70a-4160-bae6-6a7e6ba89a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:44 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4075ca82-dfe7-461f-878f-02a77537145c tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:35:44 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e
Sep 23 00:35:44 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-4b77c26d-a668-4fc3-8777-1d5bcf12dce3-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-4b77c26d-a668-4fc3-8777-1d5bcf12dce3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-quobyte-4b77c26d-a668-4fc3-8777-1d5bcf12dce3" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-4b77c26d-a668-4fc3-8777-1d5bcf12dce3" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db3725-28c9-4ec5-bc3b-bac4d32b3a26]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3
Sep 23 00:35:44 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:44 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e" returned: 0 in 0.465s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc
Sep 23 00:35:44 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot a6483215-db24-418b-8c7f-2ee820e242e7 of volume 7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe203e-e39d-464b-8e57-9c790a4c22af]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f
Sep 23 00:35:44 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:44 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3" returned: 0 in 0.481s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3
Sep 23 00:35:44 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:44 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" returned: 0 in 0.414s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:44 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc
Sep 23 00:35:44 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-4b77c26d-a668-4fc3-8777-1d5bcf12dce3" returned: 0 in 0.298s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-4b77c26d-a668-4fc3-8777-1d5bcf12dce3" released by "delete_volume" :: held 0.839s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f" returned: 0 in 0.468s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e.41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" returned: 0 in 0.274s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 1G
Sep 23 00:35:45 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-41a5e3d1-74ba-4fa5-a21b-95cebd7653cc" released by "_delete_snapshot" :: held 1.676s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-db7d9d96-f394-4619-99b3-d6f242e36d6e" released by "delete_snapshot" :: held 1.704s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Created reservations ['24d42e36-1854-4e09-aba2-870b32abb464', '0e36f39c-17ea-4267-abc2-25034b5a04a7', 'af0143d1-606c-47e3-8b05-91e7f18569e7', '389de080-e04f-4bab-b9b6-b1b4be5fae34', 'c2f17dc3-ff3c-4af6-98a1-299118c6d8e4'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Created reservations ['26ab8925-9d41-464d-b804-1ece9308e70f', '408b11b5-48bc-471b-955d-6edc2a9eaebd', '5de080b5-70cc-40e0-8d5b-dd42f6f4a461', 'c1598ee1-fec3-4577-a01c-55183e00bf42', '57aa0c8a-691b-42f8-b7ae-b991e0178885'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:45 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Delete snapshot completed successfully.
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f33af3ce-7dd8-4709-8eb7-4c11f32475e3 tempest-ProjectReaderTests-173410677 None] Lock "cinder-41a5e3d1-74ba-4fa5-a21b-95cebd7653cc-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-db7d9d96-f394-4619-99b3-d6f242e36d6e-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Lock "cinder-db7d9d96-f394-4619-99b3-d6f242e36d6e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:45 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 1G" returned: 0 in 0.593s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff35a49-e80e-473f-ac05-78562531021f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.384s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:45 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff35a49-e80e-473f-ac05-78562531021f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7
Sep 23 00:35:45 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Deleted volume successfully.
Sep 23 00:35:45 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Acquiring lock "cinder-quobyte-db7d9d96-f394-4619-99b3-d6f242e36d6e" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-69cdd038-759c-4280-bcb2-b96702aaeb78 tempest-ProjectReaderTests-1703755618 None] Lock "cinder-4b77c26d-a668-4fc3-8777-1d5bcf12dce3-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-db7d9d96-f394-4619-99b3-d6f242e36d6e" acquired by "delete_volume" :: waited 0.038s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[898559ec-ef9f-4e27-b2fc-963abd5a1cf4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:45 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e
Sep 23 00:35:45 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (78bf497e-7573-4b31-a463-79be9a0748ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fec61b-3307-40f5-b316-ccb59189027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:46 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff35a49-e80e-473f-ac05-78562531021f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7" returned: 0 in 0.390s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 is being set with open permissions: ugo+rw
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fec61b-3307-40f5-b316-ccb59189027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913596639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29318b01-86a4-4b32-a037-b0a27e59f38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:46Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:46 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f274f2ba-48f2-4677-b648-e1e4f91afefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f274f2ba-48f2-4677-b648-e1e4f91afefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19407c0-77d1-4d81-823f-d26c808e4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19407c0-77d1-4d81-823f-d26c808e4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29318b01-86a4-4b32-a037-b0a27e59f38b', 'volume_name': 'volume-29318b01-86a4-4b32-a037-b0a27e59f38b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7357a46f-4d25-4328-ad9a-275a62d38605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7357a46f-4d25-4328-ad9a-275a62d38605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1818513-ecd5-4894-bb2e-eaad7c10605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:46 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Volume 29318b01-86a4-4b32-a037-b0a27e59f38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29318b01-86a4-4b32-a037-b0a27e59f38b', 'volume_size': 1}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:46 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e" returned: 0 in 0.386s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e
Sep 23 00:35:46 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7" returned: 0 in 0.273s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info
Sep 23 00:35:46 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-db7d9d96-f394-4619-99b3-d6f242e36d6e" returned: 0 in 0.261s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Lock "cinder-quobyte-db7d9d96-f394-4619-99b3-d6f242e36d6e" released by "delete_volume" :: held 0.739s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Created reservations ['e8b283f7-4ec1-45e4-9bda-221c6ad919d0', 'b11cc456-e36d-40c7-bd1d-c0300d947a0a', '64dd888c-fdea-4c2e-90ab-1fa1dbc6baa3', '798e90d5-7175-4b12-86ca-fb900ca02434', '25c85eca-d8c8-40c3-b214-2e197dc8e68e'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:46 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info" returned: 0 in 0.320s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info is being set with open permissions: ugo+rw
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:46 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info
Sep 23 00:35:46 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:46 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:47 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.345s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:47 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Deleted volume successfully.
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.info" returned: 0 in 0.400s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913596639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29318b01-86a4-4b32-a037-b0a27e59f38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1822d95822604bb6b01149a42171468a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:46Z,use_quota=True,user_id='455ec24660b248a2aebd4b55260d6773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Creating volume 29318b01-86a4-4b32-a037-b0a27e59f38b {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:47 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:47 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b 1073741824
Sep 23 00:35:47 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f011ba1c-3446-4423-bc0e-7589768fcdfb tempest-ProjectReaderTests-173410677 None] Lock "cinder-db7d9d96-f394-4619-99b3-d6f242e36d6e-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:47 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b33d72e8-e1b5-4df0-aca6-e1bd649ff6df tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:35:47 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b 1073741824" returned: 0 in 0.489s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:47 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b
Sep 23 00:35:47 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-a6483215-db24-418b-8c7f-2ee820e242e7-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-a6483215-db24-418b-8c7f-2ee820e242e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-7ff35a49-e80e-473f-ac05-78562531021f" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-7ff35a49-e80e-473f-ac05-78562531021f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-a6483215-db24-418b-8c7f-2ee820e242e7" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a6483215-db24-418b-8c7f-2ee820e242e7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot a6483215-db24-418b-8c7f-2ee820e242e7 of volume 7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:47 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:47 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b" returned: 0 in 0.343s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1818513-ecd5-4894-bb2e-eaad7c10605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29318b01-86a4-4b32-a037-b0a27e59f38b', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f00700-721c-4275-8068-dfb6d972fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[91023f94-ef1f-458e-bc10-d45be11d0c2f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:48 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Volume volume-29318b01-86a4-4b32-a037-b0a27e59f38b (29318b01-86a4-4b32-a037-b0a27e59f38b): created successfully
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f00700-721c-4275-8068-dfb6d972fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Flow 'volume_create_manager' (78bf497e-7573-4b31-a463-79be9a0748ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:48 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cd54ce99-ddf4-4a27-9a2b-e5605a05c8af tempest-ProjectReaderTests-1703755618 None] Created volume successfully.
Sep 23 00:35:48 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7
Sep 23 00:35:48 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:48 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7" returned: 0 in 0.428s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff35a49-e80e-473f-ac05-78562531021f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf050ee-0871-48ef-915e-508bb7160adc]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:48 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f
Sep 23 00:35:48 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:48 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:48 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7
Sep 23 00:35:48 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-29318b01-86a4-4b32-a037-b0a27e59f38b-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Lock "cinder-29318b01-86a4-4b32-a037-b0a27e59f38b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:49 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Acquiring lock "cinder-quobyte-29318b01-86a4-4b32-a037-b0a27e59f38b" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7" returned: 0 in 0.462s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-29318b01-86a4-4b32-a037-b0a27e59f38b" acquired by "delete_volume" :: waited 0.045s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:49 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7
Sep 23 00:35:49 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e17225-37bd-4960-98f6-fdcbde5895c2]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:49 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b
Sep 23 00:35:49 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:49 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f.a6483215-db24-418b-8c7f-2ee820e242e7" returned: 0 in 0.306s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a6483215-db24-418b-8c7f-2ee820e242e7" released by "_delete_snapshot" :: held 1.782s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-7ff35a49-e80e-473f-ac05-78562531021f" released by "delete_snapshot" :: held 1.816s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Created reservations ['b69c191f-4844-4f57-9d46-78d106ec82b7', '61cb8846-2e80-4ae7-a740-b0b01893c2e2', '800af9d1-b76d-4ebb-8362-3d3b6d04a31b', 'a7d1535b-1c5c-4ae4-a4a6-3187b0bf0b79', '4c4bf843-a6ba-43fa-b9c6-9265bac735a1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:49 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-626d62e9-ef9b-4ff6-be7f-1b2434758299 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-a6483215-db24-418b-8c7f-2ee820e242e7-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:49 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b" returned: 0 in 0.507s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:49 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b
Sep 23 00:35:50 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-7ff35a49-e80e-473f-ac05-78562531021f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Lock "cinder-7ff35a49-e80e-473f-ac05-78562531021f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-7ff35a49-e80e-473f-ac05-78562531021f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-7ff35a49-e80e-473f-ac05-78562531021f" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d8fc7c-c774-43e8-8be6-df103cf0abc9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-29318b01-86a4-4b32-a037-b0a27e59f38b" returned: 0 in 0.344s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Lock "cinder-quobyte-29318b01-86a4-4b32-a037-b0a27e59f38b" released by "delete_volume" :: held 0.925s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Created reservations ['ece7e7b4-fde3-4ca1-b0fb-203f138104bc', '1d9ae4ca-47e2-4e4e-9f35-471af6029ffd', '7f1e9f3b-17c5-4147-b3e8-2636873b6584', '7841205e-a962-44ed-a0f5-6da5cf2e204e', '8b668d80-ec72-49ee-bf63-703d2f513963'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:50 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f
Sep 23 00:35:50 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:50 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:50 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f" returned: 0 in 0.505s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f
Sep 23 00:35:50 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:50 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.331s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:50 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Deleted volume successfully.
Sep 23 00:35:50 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ff0d5b8a-562e-4025-9500-1e96d802e04f tempest-ProjectReaderTests-1703755618 None] Lock "cinder-29318b01-86a4-4b32-a037-b0a27e59f38b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:51 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-7ff35a49-e80e-473f-ac05-78562531021f" returned: 0 in 0.318s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-7ff35a49-e80e-473f-ac05-78562531021f" released by "delete_volume" :: held 0.919s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Created reservations ['392ecf13-542b-4043-9b5a-48591b4f0bd8', 'c78ed8ca-3413-4c9f-b313-615ac22e395e', 'c81c1b8e-b924-401b-b870-3d96f60cd0ef', '8414b6f1-d552-4b36-9293-a8f290de495c', 'c8921c6e-bbb2-4d67-9047-a689d67c7d52'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:51 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:35:51 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:51 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.319s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:51 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:35:51 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d43bc310-1f45-4817-85a5-c61eb939f88a tempest-ProjectMemberTests-1230768810 None] Lock "cinder-7ff35a49-e80e-473f-ac05-78562531021f-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (aa868ab4-88b6-4124-a539-3e9c3864ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c794a8f4-5cc9-4c7a-b643-3f7cb52a32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c794a8f4-5cc9-4c7a-b643-3f7cb52a32ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399667247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee92a31f-aeeb-4a87-a796-fab65f5ce32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:52Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb4fc42-834a-4320-8830-06100abc61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb4fc42-834a-4320-8830-06100abc61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ea95d9-4238-4c4e-9fe1-ffeb14e579df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ea95d9-4238-4c4e-9fe1-ffeb14e579df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee92a31f-aeeb-4a87-a796-fab65f5ce32d', 'volume_name': 'volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e00a15f-2a14-4ccd-9cc4-518090f6c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e00a15f-2a14-4ccd-9cc4-518090f6c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a7ca8d-d747-4ae0-bc98-f0cf3ae9eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:52 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Volume ee92a31f-aeeb-4a87-a796-fab65f5ce32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d', 'volume_size': 1}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399667247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee92a31f-aeeb-4a87-a796-fab65f5ce32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:52Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Creating volume ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:52 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:52 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d 1073741824
Sep 23 00:35:52 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:52 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:52 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d 1073741824" returned: 0 in 0.548s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:53 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d
Sep 23 00:35:53 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:53 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" returned: 0 in 0.281s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a7ca8d-d747-4ae0-bc98-f0cf3ae9eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f269be5-1369-4697-aed3-40c4767fbcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:53 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Volume volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d (ee92a31f-aeeb-4a87-a796-fab65f5ce32d): created successfully
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f269be5-1369-4697-aed3-40c4767fbcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:53 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (aa868ab4-88b6-4124-a539-3e9c3864ef29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:53 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-4b39efd3-0a4a-47e8-bc07-9a08cc65547d tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot 3f49adca-79d3-4935-9409-86d8fca2bd49 of volume ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd9ceda-753b-47a4-8bf5-bcfb3503cd49]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:54 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d
Sep 23 00:35:54 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:54 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:54 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:54 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 1G
Sep 23 00:35:54 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:55 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 1G" returned: 0 in 0.418s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:55 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49
Sep 23 00:35:55 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:55 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49" returned: 0 in 0.292s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:55 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 is being set with open permissions: ugo+rw
Sep 23 00:35:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:55 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49
Sep 23 00:35:55 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:55 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:56 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info
Sep 23 00:35:56 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:56 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:56 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info is being set with open permissions: ugo+rw
Sep 23 00:35:56 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:56 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info
Sep 23 00:35:56 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:57 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.info" returned: 0 in 0.271s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:57 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:58 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-39e561ce-4bab-44b4-a7cd-22431946ab01 tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-3f49adca-79d3-4935-9409-86d8fca2bd49-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-3f49adca-79d3-4935-9409-86d8fca2bd49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-3f49adca-79d3-4935-9409-86d8fca2bd49" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-3f49adca-79d3-4935-9409-86d8fca2bd49" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot 3f49adca-79d3-4935-9409-86d8fca2bd49 of volume ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b6b5b6-4b5f-4c28-a04d-af8cfb586b11]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:59 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:00 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49
Sep 23 00:36:00 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:00 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:00 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:00 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9060e53-0743-4b33-b0c9-90b70d9fefd3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:00 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d
Sep 23 00:36:00 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:00 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" returned: 0 in 0.408s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:00 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:00 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49
Sep 23 00:36:00 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:01 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49" returned: 0 in 0.442s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:01 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49
Sep 23 00:36:01 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:01 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d.3f49adca-79d3-4935-9409-86d8fca2bd49" returned: 0 in 0.285s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-3f49adca-79d3-4935-9409-86d8fca2bd49" released by "_delete_snapshot" :: held 1.638s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" released by "delete_snapshot" :: held 1.663s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:UPDATE=289,cinder:DELETE=23,cinder:SELECT=224,cinder:INSERT=82 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Created reservations ['e3dfd05f-88dd-439d-a86e-c6bb917c42ed', '05c0e928-61bf-4142-8d40-0bccf59c2c4b', 'c5529dcb-69e4-4516-868c-ff739c2f25c4', '90e30537-56aa-4446-b269-b7b835206d7e', '45013792-f29e-45ca-9ca4-34a20ba5f242'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:01 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:36:01 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-f20fe3da-ec40-4f56-8b1a-f0e7a1b2d199 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-3f49adca-79d3-4935-9409-86d8fca2bd49-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-ee92a31f-aeeb-4a87-a796-fab65f5ce32d-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-ee92a31f-aeeb-4a87-a796-fab65f5ce32d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=222,cinder:INSERT=85,cinder:UPDATE=304,cinder:DELETE=23 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" acquired by "delete_volume" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1ee630-1792-4ada-b010-c18f583412d9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:02 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d
Sep 23 00:36:02 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:02 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" returned: 0 in 0.429s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:02 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:02 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d
Sep 23 00:36:02 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:02 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" returned: 0 in 0.289s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-ee92a31f-aeeb-4a87-a796-fab65f5ce32d" released by "delete_volume" :: held 0.809s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Created reservations ['be605213-a0ec-43c7-810e-af7e427144b0', '60fcc180-c145-4a32-836f-d91a6f313488', '3458e729-2dac-4dc1-822f-f7e957248ecb', 'c170bb10-634d-4517-9d15-3b8f3e213952', '8492a70c-fbd9-4928-a63a-091427a81360'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:03 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:03 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:03 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.326s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:03 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-0d580815-73de-4397-8ce1-7aca4fc38f03 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-ee92a31f-aeeb-4a87-a796-fab65f5ce32d-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:03 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (42894e9d-308b-45fb-80cf-69e078740eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f82448e-c53b-421b-b621-62354553a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f82448e-c53b-421b-b621-62354553a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081475098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83503c17-f1fa-4363-8ac9-75ed34080e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:04Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533814c4-df2f-496d-aa98-e0cd867b9b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533814c4-df2f-496d-aa98-e0cd867b9b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d4bf88-ea82-46fa-82b7-7d2a0b8d3f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d4bf88-ea82-46fa-82b7-7d2a0b8d3f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83503c17-f1fa-4363-8ac9-75ed34080e90', 'volume_name': 'volume-83503c17-f1fa-4363-8ac9-75ed34080e90', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a932c38c-27cf-445e-809a-d23aa658b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a932c38c-27cf-445e-809a-d23aa658b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628dd679-b0b1-436f-a9e0-175deea9977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Volume 83503c17-f1fa-4363-8ac9-75ed34080e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83503c17-f1fa-4363-8ac9-75ed34080e90', 'volume_size': 1}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081475098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83503c17-f1fa-4363-8ac9-75ed34080e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:04Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Creating volume 83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:04 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:04 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 1073741824
Sep 23 00:36:04 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:04 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 1073741824" returned: 0 in 0.518s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:04 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90
Sep 23 00:36:04 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:04 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90" returned: 0 in 0.266s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628dd679-b0b1-436f-a9e0-175deea9977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83503c17-f1fa-4363-8ac9-75ed34080e90', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fec205-f5bf-4529-aeda-8add446c8ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Volume volume-83503c17-f1fa-4363-8ac9-75ed34080e90 (83503c17-f1fa-4363-8ac9-75ed34080e90): created successfully
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fec205-f5bf-4529-aeda-8add446c8ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (42894e9d-308b-45fb-80cf-69e078740eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:04 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-1597d6e6-5c57-4309-86d5-1670b7992e5c tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot f7d3d82f-d42b-4fd6-932f-e30c612e898e of volume 83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede54e7-8130-44c4-bc6b-9b9ceb82d95d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:06 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90
Sep 23 00:36:06 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:06 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90" returned: 0 in 0.385s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:06 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:06 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e 1G
Sep 23 00:36:06 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e 1G" returned: 0 in 0.426s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83503c17-f1fa-4363-8ac9-75ed34080e90 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:07 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83503c17-f1fa-4363-8ac9-75ed34080e90 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e
Sep 23 00:36:07 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83503c17-f1fa-4363-8ac9-75ed34080e90 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e" returned: 0 in 0.308s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e is being set with open permissions: ugo+rw
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:07 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e
Sep 23 00:36:07 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e" returned: 0 in 0.258s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:07 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info
Sep 23 00:36:07 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info" returned: 0 in 0.270s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info is being set with open permissions: ugo+rw
Sep 23 00:36:07 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:08 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info
Sep 23 00:36:08 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:08 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.info" returned: 0 in 0.271s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:08 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:08 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6adc4880-73bb-4c2f-83fc-48373639416d tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-f7d3d82f-d42b-4fd6-932f-e30c612e898e-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-f7d3d82f-d42b-4fd6-932f-e30c612e898e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-83503c17-f1fa-4363-8ac9-75ed34080e90" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-83503c17-f1fa-4363-8ac9-75ed34080e90" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-f7d3d82f-d42b-4fd6-932f-e30c612e898e" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-f7d3d82f-d42b-4fd6-932f-e30c612e898e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot f7d3d82f-d42b-4fd6-932f-e30c612e898e of volume 83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eed6cd-4b6b-4248-acb4-fdb29cc4ef2b]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:09 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e
Sep 23 00:36:09 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:09 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e" returned: 0 in 0.408s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:09 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83503c17-f1fa-4363-8ac9-75ed34080e90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:10 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[34132036-6855-48d0-96cc-706250c063fa]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:10 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90
Sep 23 00:36:10 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:10 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90" returned: 0 in 0.500s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:10 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e
Sep 23 00:36:10 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:10 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e" returned: 0 in 0.377s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:10 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:10 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e
Sep 23 00:36:10 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:11 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90.f7d3d82f-d42b-4fd6-932f-e30c612e898e" returned: 0 in 0.275s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-f7d3d82f-d42b-4fd6-932f-e30c612e898e" released by "_delete_snapshot" :: held 1.714s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-83503c17-f1fa-4363-8ac9-75ed34080e90" released by "delete_snapshot" :: held 1.749s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Created reservations ['c31bf14f-f5d2-4da6-a554-13d360560ab0', 'd5806d16-48d8-4b9f-b6ef-74599efa12de', '87543e18-b20d-4b98-b2a7-847d1f51c17e', '3bd827a0-958a-4009-a1fd-25316db84a86', '7ac203b0-0da4-4912-98c2-8768e5e1d055'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:11 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-5d5256c0-c64b-4e27-ac5d-eb984563d590 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-f7d3d82f-d42b-4fd6-932f-e30c612e898e-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-83503c17-f1fa-4363-8ac9-75ed34080e90-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-83503c17-f1fa-4363-8ac9-75ed34080e90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-83503c17-f1fa-4363-8ac9-75ed34080e90" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-83503c17-f1fa-4363-8ac9-75ed34080e90" acquired by "delete_volume" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c46b142-207d-4c00-a700-2caf385f71fe]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:11 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:11 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90
Sep 23 00:36:11 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:12 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90" returned: 0 in 0.458s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:12 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90
Sep 23 00:36:12 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:12 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-83503c17-f1fa-4363-8ac9-75ed34080e90" returned: 0 in 0.284s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-83503c17-f1fa-4363-8ac9-75ed34080e90" released by "delete_volume" :: held 0.826s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Created reservations ['1ce9aab1-f886-477b-b305-eae9bfabd75b', '98a76da9-0e82-4680-8fe5-87218ea39a66', '5e1ea360-3004-4022-82db-253ea2bf5f34', '4eff5ad3-7834-4495-af4a-fe0728d47677', '36323132-6f1a-408e-91cc-675759802413'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:12 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:12 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:12 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:13 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.361s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:13 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-ba484ec5-6e96-4099-9279-cd717a546645 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-83503c17-f1fa-4363-8ac9-75ed34080e90-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (00b9c5aa-00a4-4f79-b1cd-59b0a14a726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f274e398-843c-4d67-bb16-d4049fa5009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f274e398-843c-4d67-bb16-d4049fa5009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167086758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:13Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece0eb60-b878-46d4-adf6-0701ce1b508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece0eb60-b878-46d4-adf6-0701ce1b508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8639aadd-8138-47ff-9b00-3386ceb17cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8639aadd-8138-47ff-9b00-3386ceb17cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb', 'volume_name': 'volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b173b4d-f301-4a38-873e-7b87c8afe6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b173b4d-f301-4a38-873e-7b87c8afe6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1833a58-f754-4cd8-80ed-e2688edf8732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:13 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Volume 0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb', 'volume_size': 1}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167086758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:13Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Creating volume 0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:13 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:36:13 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:13 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb 1073741824
Sep 23 00:36:13 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:14 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb 1073741824" returned: 0 in 0.525s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:14 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb
Sep 23 00:36:14 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:14 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" returned: 0 in 0.274s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1833a58-f754-4cd8-80ed-e2688edf8732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b91040-7dd0-4a0a-90e4-6ce25da278c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:14 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Volume volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb (0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb): created successfully
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b91040-7dd0-4a0a-90e4-6ce25da278c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:14 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (00b9c5aa-00a4-4f79-b1cd-59b0a14a726a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:14 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8a1ab34c-468a-4541-bba4-4f9ff7641fb6 tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:36:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:15 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot e912f537-4233-4882-a2d7-1286678233d7 of volume 0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:15 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02e4d5-f7be-4dbe-9cd5-d13956f64250]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:15 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:15 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb
Sep 23 00:36:15 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:16 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" returned: 0 in 0.389s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:16 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 1G
Sep 23 00:36:16 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Flow 'volume_create_manager' (6c64d604-a9f6-426d-8bbe-62020cedfa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fb9531-3fc7-48de-b377-490aa4a43396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fb9531-3fc7-48de-b377-490aa4a43396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-292711441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060eacf1-e6ab-4b0f-9b19-51f15cd4d92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc777a38fa3424a93f0fb9a0c97a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:16Z,use_quota=True,user_id='df24be6911764810a2ba1f9a1eeb51b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c019bc6-627a-4a58-9dba-03475723f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c019bc6-627a-4a58-9dba-03475723f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4be011e-888e-4c74-902c-42e235022f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4be011e-888e-4c74-902c-42e235022f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060eacf1-e6ab-4b0f-9b19-51f15cd4d92f', 'volume_name': 'volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4af358-4617-4f54-9817-e50581036186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4af358-4617-4f54-9817-e50581036186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82d5758-c3b5-4d69-b0b3-9e2a3216d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:16 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Volume 060eacf1-e6ab-4b0f-9b19-51f15cd4d92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f', 'volume_size': 1}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:16 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 1G" returned: 0 in 0.400s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:16 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7
Sep 23 00:36:16 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:16 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7" returned: 0 in 0.269s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:16 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 is being set with open permissions: ugo+rw
Sep 23 00:36:16 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:16 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7
Sep 23 00:36:16 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:17 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7" returned: 0 in 0.237s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:17 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info
Sep 23 00:36:17 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:17 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info" returned: 0 in 0.239s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:17 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info is being set with open permissions: ugo+rw
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:17 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info
Sep 23 00:36:17 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:17 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.info" returned: 0 in 0.243s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-292711441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060eacf1-e6ab-4b0f-9b19-51f15cd4d92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc777a38fa3424a93f0fb9a0c97a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:16Z,use_quota=True,user_id='df24be6911764810a2ba1f9a1eeb51b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Creating volume 060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:17 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:17 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f 1073741824
Sep 23 00:36:17 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:17 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9cac6d3a-145d-434a-b324-983a7fad730d tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-e912f537-4233-4882-a2d7-1286678233d7-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-e912f537-4233-4882-a2d7-1286678233d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-e912f537-4233-4882-a2d7-1286678233d7" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-e912f537-4233-4882-a2d7-1286678233d7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot e912f537-4233-4882-a2d7-1286678233d7 of volume 0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30efe0e-f78b-4328-b104-0db5a22b548e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:17 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:18 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7
Sep 23 00:36:18 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:18 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f 1073741824" returned: 0 in 0.539s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:18 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f
Sep 23 00:36:18 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:18 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93a786-360b-4776-b40a-98da5f9dc41d]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:18 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" returned: 0 in 0.256s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82d5758-c3b5-4d69-b0b3-9e2a3216d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59abaac-dbd5-4cc3-b5ce-8ec6f63f91a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:18 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Volume volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f (060eacf1-e6ab-4b0f-9b19-51f15cd4d92f): created successfully
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59abaac-dbd5-4cc3-b5ce-8ec6f63f91a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Flow 'volume_create_manager' (6c64d604-a9f6-426d-8bbe-62020cedfa25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:18 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bd8b3f9c-942b-4a19-b422-a2ea102d8805 tempest-SnapshotDependencyTests-505538377 None] Created volume successfully.
Sep 23 00:36:18 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb
Sep 23 00:36:18 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:18 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" returned: 0 in 0.368s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:18 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:18 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7
Sep 23 00:36:18 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:19 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7" returned: 0 in 0.366s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:19 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7
Sep 23 00:36:19 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:19 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb.e912f537-4233-4882-a2d7-1286678233d7" returned: 0 in 0.276s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-e912f537-4233-4882-a2d7-1286678233d7" released by "_delete_snapshot" :: held 1.558s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" released by "delete_snapshot" :: held 1.586s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Created reservations ['9cdbc798-9a63-4079-ada6-3b012c085f3f', 'ad341974-ef15-4d2d-9a73-5afa630e23f4', 'b0047c03-0072-4882-bb22-d1255c9a8d3a', '57d7fbc7-3645-44e7-9705-9a102fe967c0', 'bf6fc7cc-ce30-486b-8a14-9e8f0c5eabf1'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:19 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-d750a40a-93c5-407b-9a8b-68643d0b0289 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-e912f537-4233-4882-a2d7-1286678233d7-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Creating offline snapshot 47ea8ccf-a2c1-429e-976a-ca99c4ec38de of volume 060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99c1bcd-c9c5-4ece-bc91-0dda3c77601a]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:19 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f
Sep 23 00:36:19 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:19 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" acquired by "delete_volume" :: waited 0.022s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afe88b3-2adf-4eab-9702-0485c2f402a7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:20 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" returned: 0 in 0.407s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:20 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de 1G
Sep 23 00:36:20 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:20 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb
Sep 23 00:36:20 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:20 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" returned: 0 in 0.386s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:20 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb
Sep 23 00:36:20 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:20 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de 1G" returned: 0 in 0.423s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:20 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de
Sep 23 00:36:20 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:20 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" returned: 0 in 0.277s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb" released by "delete_volume" :: held 0.734s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Created reservations ['9995daa0-2b12-4c96-bb2d-3f2583504fc9', '87fcfafd-9d33-4065-ac8e-213aafe14863', '026f889d-4015-4f12-a62a-d6395a4d7184', '7a029339-0368-4ec8-a807-f55912a515f5', 'aa0b2bb9-c06e-470c-b51c-764f713e6bf2'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:20 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de" returned: 0 in 0.366s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:20 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de is being set with open permissions: ugo+rw
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:20 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de
Sep 23 00:36:20 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:20 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:21 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:21 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:21 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de" returned: 0 in 0.275s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:21 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.283s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:36:21 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info
Sep 23 00:36:21 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-502e43b7-ce8f-4892-8fa8-36a8722e9c81 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-0d5e03eb-7c9f-4a99-bc43-18b9b40a31eb-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:21 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info" returned: 0 in 0.350s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:21 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info is being set with open permissions: ugo+rw
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:21 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info
Sep 23 00:36:21 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (7c3be380-1fde-404b-a4f1-03c8ee8bf761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a35a5c9-a5e2-4028-a799-0d51a9624956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a35a5c9-a5e2-4028-a799-0d51a9624956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409882287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937e75cf-8e21-45e9-b5ac-cefb99376149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cba627-71df-49f6-aa0b-2e529ab22779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cba627-71df-49f6-aa0b-2e529ab22779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efbbfb6-c50b-45a6-b87f-a2135c255abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efbbfb6-c50b-45a6-b87f-a2135c255abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937e75cf-8e21-45e9-b5ac-cefb99376149', 'volume_name': 'volume-937e75cf-8e21-45e9-b5ac-cefb99376149', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dd1988-8941-4a88-97a8-ebdc61f93927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dd1988-8941-4a88-97a8-ebdc61f93927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3b323f-3f10-4c8c-b28f-11ef5fc40bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:21 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Volume 937e75cf-8e21-45e9-b5ac-cefb99376149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937e75cf-8e21-45e9-b5ac-cefb99376149', 'volume_size': 1}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:21 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.info" returned: 0 in 0.268s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409882287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937e75cf-8e21-45e9-b5ac-cefb99376149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Creating volume 937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:21 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:36:21 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:21 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 1073741824
Sep 23 00:36:21 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:21 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-65c21fd1-2a1f-4571-bde0-4f14a393f95c tempest-SnapshotDependencyTests-505538377 None] Create snapshot completed successfully
Sep 23 00:36:22 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 1073741824" returned: 0 in 0.419s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:22 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149
Sep 23 00:36:22 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:22 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149" returned: 0 in 0.242s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3b323f-3f10-4c8c-b28f-11ef5fc40bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937e75cf-8e21-45e9-b5ac-cefb99376149', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f1631a-c158-43f7-83e0-9f9b4dd8b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Volume volume-937e75cf-8e21-45e9-b5ac-cefb99376149 (937e75cf-8e21-45e9-b5ac-cefb99376149): created successfully
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f1631a-c158-43f7-83e0-9f9b4dd8b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (7c3be380-1fde-404b-a4f1-03c8ee8bf761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:22 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8b6d4d77-c972-4fc2-9e97-2db41c6d01fe tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:22 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot 3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 of volume 937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[277bd103-fe86-4aaa-b31d-51f8ac6c41d7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:23 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149
Sep 23 00:36:23 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:23 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149" returned: 0 in 0.402s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:23 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 1G
Sep 23 00:36:23 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Flow 'volume_create_manager' (ee0d9ae5-25a2-4d4a-94a5-2f3df179f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4671b74-5b97-4de7-8dac-b40b70694b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4671b74-5b97-4de7-8dac-b40b70694b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc777a38fa3424a93f0fb9a0c97a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47ea8ccf-a2c1-429e-976a-ca99c4ec38de,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:23Z,use_quota=True,user_id='df24be6911764810a2ba1f9a1eeb51b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222af741-d7d9-47cf-b273-bdaa2381c848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222af741-d7d9-47cf-b273-bdaa2381c848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b8f1c3-b59e-4185-a56a-cc7346bad8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b8f1c3-b59e-4185-a56a-cc7346bad8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60', 'volume_name': 'volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60', 'volume_size': 1, 'snapshot_id': '47ea8ccf-a2c1-429e-976a-ca99c4ec38de'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b671a447-6da3-4f6c-8833-88a22d4a45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b671a447-6da3-4f6c-8833-88a22d4a45e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f52079-0700-4540-9831-361d55c89cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:23 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Volume fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60', 'volume_size': 1, 'snapshot_id': '47ea8ccf-a2c1-429e-976a-ca99c4ec38de'}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:23 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 1G" returned: 0 in 0.386s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:23 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937e75cf-8e21-45e9-b5ac-cefb99376149 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:23 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937e75cf-8e21-45e9-b5ac-cefb99376149 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98
Sep 23 00:36:23 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:24 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937e75cf-8e21-45e9-b5ac-cefb99376149 -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" returned: 0 in 0.302s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:24 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 is being set with open permissions: ugo+rw
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:24 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98
Sep 23 00:36:24 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:24 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" returned: 0 in 0.231s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:24 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info
Sep 23 00:36:24 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:24 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info" returned: 0 in 0.243s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:24 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info is being set with open permissions: ugo+rw
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:24 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info
Sep 23 00:36:24 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:24 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.info" returned: 0 in 0.242s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.233s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-quobyte-47ea8ccf-a2c1-429e-976a-ca99c4ec38de-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" by "_create_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-47ea8ccf-a2c1-429e-976a-ca99c4ec38de-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Creating volume fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 from snapshot 47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-quobyte-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" by "_copy_volume_from_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:24 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-bb3c8f84-e37a-4e7c-8340-c728e54ed304 tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] snapshot: 47ea8ccf-a2c1-429e-976a-ca99c4ec38de, volume: fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60,  {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f2c2c1-befa-4f8f-8b2a-bebc40143a35]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:24 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de
Sep 23 00:36:25 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-3784a2f3-51ae-47a3-b3e1-1e6a56d22c98-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-3784a2f3-51ae-47a3-b3e1-1e6a56d22c98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-937e75cf-8e21-45e9-b5ac-cefb99376149" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-937e75cf-8e21-45e9-b5ac-cefb99376149" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot 3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 of volume 937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38808a23-b241-4316-aa64-071923404b21]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98
Sep 23 00:36:25 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de" returned: 0 in 0.384s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068a17f-dfaf-4a9e-ac11-80e24c24a59f]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f
Sep 23 00:36:25 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" returned: 0 in 0.408s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e75cf-8e21-45e9-b5ac-cefb99376149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7282dc47-d0b9-4d2d-8fe6-2a3a6f823f83]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" returned: 0 in 0.363s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Creating direct copy from snapshot {{(pid=87293) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG cinder.utils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Path /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 not found in is_blk_device check {{(pid=87293) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:36:25 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149
Sep 23 00:36:25 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60
Sep 23 00:36:25 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149" returned: 0 in 0.397s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98
Sep 23 00:36:26 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" returned: 0 in 0.558s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98
Sep 23 00:36:26 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149.3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" returned: 0 in 0.370s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-3784a2f3-51ae-47a3-b3e1-1e6a56d22c98" released by "_delete_snapshot" :: held 1.877s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-937e75cf-8e21-45e9-b5ac-cefb99376149" released by "delete_snapshot" :: held 1.910s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:27 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Created reservations ['963008f3-6c9d-4540-981d-db0ba0cca936', '735b76a9-25ec-4755-af55-4cefba370325', '4067de40-7089-47a5-8c7a-eba644b6762b', '2a4e8a79-5b6e-40af-a4b1-570ccbb52fd7', 'babfc11f-1c3d-4164-b969-7126eeacb671'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:27 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:36:27 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-871c5ad9-26a1-4833-a5b5-8a47008bb191 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-3784a2f3-51ae-47a3-b3e1-1e6a56d22c98-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-937e75cf-8e21-45e9-b5ac-cefb99376149-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Lock "cinder-937e75cf-8e21-45e9-b5ac-cefb99376149-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-937e75cf-8e21-45e9-b5ac-cefb99376149" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:28 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-937e75cf-8e21-45e9-b5ac-cefb99376149" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:28 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a4c5d-6212-485c-907d-e2e971883ba5]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:28 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:28 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149
Sep 23 00:36:28 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:29 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149" returned: 0 in 0.523s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:29 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149
Sep 23 00:36:29 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:29 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-937e75cf-8e21-45e9-b5ac-cefb99376149" returned: 0 in 0.382s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-937e75cf-8e21-45e9-b5ac-cefb99376149" released by "delete_volume" :: held 1.034s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Created reservations ['e42dcfb5-f696-40ae-aa2b-66df0f024d90', 'a679bf6f-2fb9-4609-8ca4-de6e1e2ab203', '05058c3a-8cd5-4c43-ab7c-dd240beccb0b', '526c87a1-141c-4671-810c-9b0bb1a36900', '894d86ca-eaa4-439b-bd1f-ced6f06d5449'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:29 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:29 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:29 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:30 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:30 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.361s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:30 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:30 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:36:30 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9052bae5-431c-4c1f-9498-277df7ab6bda tempest-ProjectMemberTests-1230768810 None] Lock "cinder-937e75cf-8e21-45e9-b5ac-cefb99376149-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.flows.manager.create_volume [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87293) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (ebe734f0-0bca-4976-9f21-7edb8cb4295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e643514-ccba-48f1-abcb-072567f85702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e643514-ccba-48f1-abcb-072567f85702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662959226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da81906e-fb1b-4221-b7fb-fc0298910bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:32Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eedc952-c48b-47a4-b00f-33267e9f2d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eedc952-c48b-47a4-b00f-33267e9f2d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c8d69a-c508-4afb-a46f-55ffa59872a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c8d69a-c508-4afb-a46f-55ffa59872a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da81906e-fb1b-4221-b7fb-fc0298910bda', 'volume_name': 'volume-da81906e-fb1b-4221-b7fb-fc0298910bda', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075d8213-80cb-48e8-8bc2-45d69b43a2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075d8213-80cb-48e8-8bc2-45d69b43a2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2b96fe-af87-45c8-bff1-5096c5ecaccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:31 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Volume da81906e-fb1b-4221-b7fb-fc0298910bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da81906e-fb1b-4221-b7fb-fc0298910bda', 'volume_size': 1}
Sep 23 00:36:31 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:32 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" returned: 0 in 6.612s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.image.image_utils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Image conversion details: src /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 {{(pid=87293) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:36:32 devstack cinder-volume[87293]: INFO cinder.image.image_utils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Converted 1024.00 MB image at 154.84 MB/s
Sep 23 00:36:32 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 is being set with open permissions: ugo+rw
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:32 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60
Sep 23 00:36:32 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:32 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" returned: 0 in 0.258s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" released by "_copy_volume_from_snapshot" :: held 7.700s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-47ea8ccf-a2c1-429e-976a-ca99c4ec38de-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" released by "_create_volume_from_snapshot" :: held 7.789s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.812s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74afdf9b5c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662959226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da81906e-fb1b-4221-b7fb-fc0298910bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b85ff05380141eda943acefe33943c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:32Z,use_quota=True,user_id='90d9d4ec1c774d778fdff49b45d4bfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aa0270a-ca11-4d8a-af48-ebf741d392b6),volume_type_id=5aa0270a-ca11-4d8a-af48-ebf741d392b6)}" {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Creating volume da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Selected osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5 as target Quobyte volume. {{(pid=87293) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:32 devstack cinder-volume[87293]: INFO cinder.volume.drivers.remotefs [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] casted to osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda 1073741824 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:32 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda 1073741824
Sep 23 00:36:32 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f52079-0700-4540-9831-361d55c89cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60', 'volume_size': 1, 'snapshot_id': '47ea8ccf-a2c1-429e-976a-ca99c4ec38de'}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4548ae95-91a0-46bc-895d-8921f1f11f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:32 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Volume volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 (fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60): created successfully
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4548ae95-91a0-46bc-895d-8921f1f11f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:32 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Flow 'volume_create_manager' (ee0d9ae5-25a2-4d4a-94a5-2f3df179f595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:32 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-cfe01acf-bcc3-4dcc-96cc-97f9b47aba86 tempest-SnapshotDependencyTests-505538377 None] Created volume successfully.
Sep 23 00:36:33 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda 1073741824" returned: 0 in 0.456s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:33 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda
Sep 23 00:36:33 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:33 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-47ea8ccf-a2c1-429e-976a-ca99c4ec38de-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda" returned: 0 in 0.260s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'} {{(pid=87293) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2b96fe-af87-45c8-bff1-5096c5ecaccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da81906e-fb1b-4221-b7fb-fc0298910bda', 'volume_size': 1}' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb150ed-2910-4927-8abd-ce15d43d1c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-47ea8ccf-a2c1-429e-976a-ca99c4ec38de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-quobyte-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:33 devstack cinder-volume[87293]: INFO cinder.volume.flows.manager.create_volume [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Volume volume-da81906e-fb1b-4221-b7fb-fc0298910bda (da81906e-fb1b-4221-b7fb-fc0298910bda): created successfully
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb150ed-2910-4927-8abd-ce15d43d1c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87293) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Flow 'volume_create_manager' (ebe734f0-0bca-4976-9f21-7edb8cb4295c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87293) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-quobyte-47ea8ccf-a2c1-429e-976a-ca99c4ec38de" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:33 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-132a48cd-fdcd-4b0c-8296-01c0fbf53c07 tempest-ProjectMemberTests-1230768810 None] Created volume successfully.
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-47ea8ccf-a2c1-429e-976a-ca99c4ec38de" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Deleting offline snapshot 47ea8ccf-a2c1-429e-976a-ca99c4ec38de of volume 060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] snapshot_file for this snap is: volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f464b-c256-418b-9a6e-1bae7a32aaac]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:33 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de
Sep 23 00:36:33 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:33 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de" returned: 0 in 0.417s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:33 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Creating offline snapshot a028bba3-5a73-4ff0-8668-381ab4f240e7 of volume da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4168d-4598-4eb3-990d-ab737250760e]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad4c1ce-c328-4f61-a3c5-912c9ca35be7]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f
Sep 23 00:36:34 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:34 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda
Sep 23 00:36:34 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:34 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda" returned: 0 in 0.358s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 1G {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 1G
Sep 23 00:36:34 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:34 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" returned: 0 in 0.542s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de
Sep 23 00:36:34 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:34 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 1G" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da81906e-fb1b-4221-b7fb-fc0298910bda -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da81906e-fb1b-4221-b7fb-fc0298910bda -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7
Sep 23 00:36:34 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:34 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de" returned: 0 in 0.343s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:34 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de
Sep 23 00:36:34 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da81906e-fb1b-4221-b7fb-fc0298910bda -F qcow2 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7" returned: 0 in 0.289s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 is being set with open permissions: ugo+rw
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7
Sep 23 00:36:35 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f.47ea8ccf-a2c1-429e-976a-ca99c4ec38de" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-47ea8ccf-a2c1-429e-976a-ca99c4ec38de" released by "_delete_snapshot" :: held 1.675s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" released by "delete_snapshot" :: held 1.701s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Created reservations ['9093cba6-aa60-4fcc-be92-ee683ca8b3cd', '89dedc5b-84c1-424f-b66a-d677c0914f3f', 'b8891f72-8504-450e-970d-49125f7994fe', '167008e6-207d-4d29-b3d4-0e888c8225a0', '383dd541-3519-4f4a-be7e-3a01ef886a23'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:35 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7" returned: 0 in 0.242s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Delete snapshot completed successfully.
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-b18f54f0-8974-4ef6-a32d-57549362304f tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-47ea8ccf-a2c1-429e-976a-ca99c4ec38de-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:35 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info
Sep 23 00:36:35 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info" returned: 0 in 0.247s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[87293]: WARNING cinder.volume.drivers.remotefs [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info is being set with open permissions: ugo+rw
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:35 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info
Sep 23 00:36:35 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-quobyte-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" acquired by "delete_volume" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a103ddd-c484-4e25-bfd7-7ffbdd66a9d4]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f
Sep 23 00:36:35 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.info" returned: 0 in 0.267s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:35 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-6329fc4f-83ae-4873-84d4-c10debb3d54f tempest-ProjectMemberTests-1230768810 None] Create snapshot completed successfully
Sep 23 00:36:36 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:36 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f
Sep 23 00:36:36 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-a028bba3-5a73-4ff0-8668-381ab4f240e7-delete_snapshot" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-a028bba3-5a73-4ff0-8668-381ab4f240e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-da81906e-fb1b-4221-b7fb-fc0298910bda" by "delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-da81906e-fb1b-4221-b7fb-fc0298910bda" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-a028bba3-5a73-4ff0-8668-381ab4f240e7" by "_delete_snapshot" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a028bba3-5a73-4ff0-8668-381ab4f240e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Deleting offline snapshot a028bba3-5a73-4ff0-8668-381ab4f240e7 of volume da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] snapshot_file for this snap is: volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 {{(pid=87293) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[903dccc3-63ae-4c9d-bbae-1f3d13ec52fd]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:36 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" returned: 0 in 0.261s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f" released by "delete_volume" :: held 0.722s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:36 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7
Sep 23 00:36:36 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Created reservations ['a369dabf-4360-46c6-b4e1-5adb78f3052e', 'e8837926-9ab1-4e3d-afe6-fb2a34e8b8fb', '8fc8e033-ffd6-4fa4-bfcd-01948035f2d3', 'a9970dab-b594-4a53-bb16-24fab98a668f', '8ef326e4-46a0-4dff-879c-12e9b0bdbbdc'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:36 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:36 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7" returned: 0 in 0.376s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.remotefs [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da81906e-fb1b-4221-b7fb-fc0298910bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87293) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e2e36a-7dcd-4abf-b01f-62041d42fba3]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:36 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.262s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:36 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Deleted volume successfully.
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:36 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda
Sep 23 00:36:36 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-2b94c78d-8b40-4338-a25c-f3d3045aaf90 tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-060eacf1-e6ab-4b0f-9b19-51f15cd4d92f-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "cinder-quobyte-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" acquired by "delete_volume" :: waited 0.024s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c7556-61f6-478c-b1bc-ea4e78d26ed9]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:36 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:37 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60
Sep 23 00:36:37 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:37 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda" returned: 0 in 0.420s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:37 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7
Sep 23 00:36:37 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:37 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" returned: 0 in 0.391s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:37 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60
Sep 23 00:36:37 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:37 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7" returned: 0 in 0.368s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:37 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7
Sep 23 00:36:37 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:37 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" returned: 0 in 0.292s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-quobyte-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60" released by "delete_volume" :: held 0.738s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Created reservations ['66af42ea-019d-46e2-a766-50fc6915b356', '5810ba6b-7310-4cb2-b275-9a97a3bd8cd2', '541e0930-ee6c-4ad6-848d-12c2f88aa6ab', 'b29b4879-2e54-4db9-9c43-44d9f54a07bd', 'f71198cc-d05c-4979-bf48-911684d00dec'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:37 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda.a028bba3-5a73-4ff0-8668-381ab4f240e7" returned: 0 in 0.287s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:37 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:37 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-a028bba3-5a73-4ff0-8668-381ab4f240e7" released by "_delete_snapshot" :: held 1.571s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-da81906e-fb1b-4221-b7fb-fc0298910bda" released by "delete_snapshot" :: held 1.594s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:37 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Created reservations ['b711faa8-6eb4-4cd7-b8e5-8d49bacea337', '6ed1ae6c-fc5e-470f-8eb0-f48354ffe156', '9724a097-8eac-442a-b104-e7e4ec58d06f', '0915fc29-e629-4091-b641-d6f3e2c2ae60', '48da140e-37b7-4072-9e46-7550825fbbd6'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Delete snapshot completed successfully.
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-8f87bdc5-0517-4489-9cb7-4bfa9ea6a438 tempest-ProjectMemberTests-1230768810 None] Lock "cinder-a028bba3-5a73-4ff0-8668-381ab4f240e7-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:38 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.299s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:38 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Deleted volume successfully.
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-a80188c7-7dd8-4909-92ae-f361cdf3b56b tempest-SnapshotDependencyTests-505538377 None] Lock "cinder-fda5eb03-75d2-4aaa-8fe0-83f7ec37ee60-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-da81906e-fb1b-4221-b7fb-fc0298910bda-delete_volume" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-da81906e-fb1b-4221-b7fb-fc0298910bda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Acquiring lock "cinder-quobyte-da81906e-fb1b-4221-b7fb-fc0298910bda" by "delete_volume" {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-da81906e-fb1b-4221-b7fb-fc0298910bda" acquired by "delete_volume" :: waited 0.015s {{(pid=87293) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a133bab-b037-4724-a144-8c5e87e1a158]: (4, 'qcow2') {{(pid=88813) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:38 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda
Sep 23 00:36:38 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:38 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda" returned: 0 in 0.396s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:38 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:38 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda
Sep 23 00:36:38 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:39 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88/volume-da81906e-fb1b-4221-b7fb-fc0298910bda" returned: 0 in 0.250s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-quobyte-da81906e-fb1b-4221-b7fb-fc0298910bda" released by "delete_volume" :: held 0.709s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.quota [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Created reservations ['7e1a0450-4c05-412e-8568-d172b5198cb9', 'c8eafc10-464d-476f-b1ee-a37cd7c01c1b', '86980aaa-cb49-4652-90a1-86bcd5e3295c', '73d3c38d-1b9c-48b6-b10c-d118968b51e6', '8922f478-f360-41fa-b0a6-8b890e056644'] {{(pid=87293) _reserve /opt/stack/cinder/cinder/quota.py:797}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:39 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:39 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:39 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.268s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:39 devstack cinder-volume[87293]: INFO cinder.volume.manager [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Deleted volume successfully.
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.coordination [None req-9d485995-60f5-4dc0-897c-1ed495965c2e tempest-ProjectMemberTests-1230768810 None] Lock "cinder-da81906e-fb1b-4221-b7fb-fc0298910bda-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87293) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5': None} {{(pid=87293) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG cinder.volume.drivers.quobyte [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ec38cd5-7c63-444f-8982-007f59e539d5'] {{(pid=87293) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.lockutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87293) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:39 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88 {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:40 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88
Sep 23 00:36:40 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:40 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:40 devstack cinder-volume[87293]: DEBUG oslo_concurrency.processutils [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ea18b94a9dea5a66e2efd2121cc4ee88" returned: 0 in 0.294s {{(pid=87293) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:40 devstack cinder-volume[87293]: DEBUG cinder.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Notifying Schedulers of capabilities ... {{(pid=87293) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:40 devstack cinder-volume[87293]: DEBUG oslo_service.periodic_task [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] Running periodic task VolumeManager._thread_info {{(pid=87293) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:36:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread count: 28 {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:36:40 devstack cinder-volume[87293]: DEBUG cinder.volume.manager [None req-48aa47b5-89f7-4c35-8f2b-d07de973b5e1 None None] thread info: [<_MainThread(MainThread, started 128298833834112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128298720765824)>, <Thread(Thread-3 (stat_writer), started daemon 128298722419712)>, <Thread(Rabbit-heartbeat, started daemon 128298719546176)>, <Thread(Thread-5 (_runner), started daemon 128298717249984)>, <Thread(Thread-7 (_runner), started daemon 128298717360704)>, <Thread(fd_logger, started daemon 128298713369728)>, <Thread(privsep_reader, started daemon 128298713375808)>, <Thread(tpool_thread_0, started daemon 128298708698816)>, <Thread(tpool_thread_1, started daemon 128298700306112)>, <Thread(tpool_thread_2, started daemon 128298691913408)>, <Thread(tpool_thread_3, started daemon 128298683520704)>, <Thread(tpool_thread_4, started daemon 128298675128000)>, <Thread(tpool_thread_5, started daemon 128298666735296)>, <Thread(tpool_thread_6, started daemon 128298658342592)>, <Thread(tpool_thread_7, started daemon 128298649949888)>, <Thread(tpool_thread_8, started daemon 128298641557184)>, <Thread(tpool_thread_9, started daemon 128298633164480)>, <Thread(tpool_thread_10, started daemon 128298624771776)>, <Thread(tpool_thread_11, started daemon 128298616379072)>, <Thread(tpool_thread_12, started daemon 128298607986368)>, <Thread(tpool_thread_13, started daemon 128298599593664)>, <Thread(tpool_thread_14, started daemon 128298591200960)>, <Thread(tpool_thread_15, started daemon 128298582808256)>, <Thread(tpool_thread_16, started daemon 128298574415552)>, <Thread(tpool_thread_17, started daemon 128298566022848)>, <Thread(tpool_thread_18, started daemon 128298557630144)>, <Thread(tpool_thread_19, started daemon 128298549237440)>] {{(pid=87293) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:36:49 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=97,cinder:INSERT=35,cinder:UPDATE=134,cinder:DELETE=12 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:36:49 devstack cinder-volume[87293]: DEBUG dbcounter [-] [87293] Writing DB stats cinder:SELECT=103,cinder:INSERT=39,cinder:UPDATE=116,cinder:DELETE=6 {{(pid=87293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}